Goto

Collaborating Authors

 Country





7428e6db752171d6b832c53b2ed297ab-Paper-Conference.pdf

Neural Information Processing Systems

First, we formalize the problem definition.Weintroducetheconceptof"Idon'tknow (idk) responses" and in this context, honesty necessitates that an aligned LLM provides idk responses for unknown questions and correct responses for known questions.







DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions

Neural Information Processing Systems

To answer this question, we begin by revisiting the forward procedure of ViTs. A sequence of positional embeddings (PEs) [51] is added to patch embeddings to preserve position information. Intuitively, simply discarding these PEs and requesting the model to reconstruct the position for each patch naturally becomes a qualified location-aware pretext task.