Goto

Collaborating Authors

 Country



Imbalance Trouble: Revisiting Neural-Collapse Geometry

Neural Information Processing Systems

Towards this end, we adoptthe unconstrained-features model (UFM), a recent theoretical model for studying neural collapse, and introduce Simplex-Encoded-Labels Interpolation (SELI) as an invariant characterizationof theneuralcollapsephenomenon.




Dual-streamNetworkforVisualRecognition

Neural Information Processing Systems

Inthispaper,wepresentagenericDual-stream Network(DS-Net) to fully explore the representation capacity of local and global pattern features for image classification. Our DS-Net can simultaneously calculate fine-grained and integrated features and efficiently fuse them.



Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars

Neural Information Processing Systems

The discovery of neural architectures from simple building blocks is a longstanding goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design framework and typically only search over some limited aspect of architectures. In this work, we introduce a unifying search space design framework based on context-free grammars that can naturally and compactly generate expressive hierarchical search spaces that are 100s of orders of magnitude larger than common spaces from the literature. By enhancing and using their properties, we effectively enable search over the complete architecture and can foster regularity. Further, we propose an efficient hierarchical kernel design for a Bayesian Optimization search strategy to efficiently search over such huge spaces.



Theoretical

Neural Information Processing Systems

The question of if and how rank collapse affects training is still largelyunanswered, anditsinvestigation isnecessary foramore comprehensive understanding ofthisarchitecture.