Goto

Collaborating Authors

 South America


Validating the Lottery Ticket Hypothesis with Inertial Manifold Theory

Neural Information Processing Systems

Hypothesis (L TH): a randomly-initialized dense neural network contains an extremely sparse subnet-work (i.e., a winning lottery ticket) such that, when trained from scratch with weights being reset to its initialization, can achieve similar performance to the original dense network within similar



Focal Attention for Long-Range Interactions in Vision Transformers Jianwei Y ang

Neural Information Processing Systems

Recently, Vision Transformer and its variants have shown great promise on various computer vision tasks. The ability of capturing local and global visual dependencies through self-attention is the key to its success.



An Initial Study of Bird's-Eye View Generation for Autonomous Vehicles using Cross-View Transformers

arXiv.org Artificial Intelligence

Bird's-Eye View (BEV) maps provide a structured, top-down abstraction that is crucial for autonomous-driving perception. In this work, we employ Cross-View Transformers (CVT) for learning to map camera images to three BEV's channels - road, lane markings, and planned trajectory - using a realistic simulator for urban driving. Our study examines generalization to unseen towns, the effect of different camera layouts, and two loss formulations (focal and L1). Using training data from only a town, a four-camera CVT trained with the L1 loss delivers the most robust test performance, evaluated in a new town. Overall, our results underscore CVT's promise for mapping camera inputs to reasonably accurate BEV maps.