Deep Learning
Benchmarking Complex Instruction-Following with Multiple Constraints Composition Bosi Wen
LLMs has become a critical research problem.
ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
In this paper, we introduce a novel robust attention mechanism designed to enhance the resilience of transformer-based architectures.
Confusion-Resistant Federated Learning via Diffusion-Based Data Harmonization on Non-IID Data Xiaohong Chen
Federated learning has become a pivotal distributed learning paradigm, involving collaborative model updates across multiple nodes with private data.
Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models
To address this issue, we introduce a novel binarization technique called Mixture of Scales (BinaryMoS).
Linguistic Collapse: Neural Collapse in (Large) Language Models
Convergence to a simplex ETF: Class means tend towards equinorm and equiangular vectors when centred about the global average.
Task-oriented Time Series Imputation Evaluation via Generalized Representers Zhixian Wang 1,2, Linxiao Y ang
Specifically, we summarize our contributions into the following points.
ActionAtlas: A VideoQA Benchmark for Domain-specialized Action Recognition Mohammadreza Salehi Jae Sung Park
Each video in the dataset is paired with a question and four or five choices.
Interpreting the Weight Space of Customized Diffusion Models
We populate this space by creating a dataset of over 60,000 models, each of which is a base model fine-tuned to insert a different person's