Goto

Collaborating Authors

 Government


VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images

Neural Information Processing Systems

Hence, we consider asking a VLM to provide the scientific name of the organism shown in a given image. There are two types of questions that we consider for this task. First, we consider open-ended questions, where we do not provide any answer choices (or options) to the VLM in the input prompt.




VastTrack: Vast Category Visual Object Tracking

Neural Information Processing Systems

V astTrack consists of a few attractive properties: (1) V ast Object Category . In particular, it covers targets from 2,115 categories, significantly surpassing object classes of existing popular benchmarks ( e.g ., GOT -10k with 563 classes and LaSOT with 70 categories). Through providing such vast object classes, we expect to learn more general object tracking.



B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory

Neural Information Processing Systems

We leverage ideas from Stochastic Realization Theory to develop a class of models called B'MOJO to seamlessly combine eidetic and fading memory within an elementary composable module. The overall architecture can be used to implement models that can access short-term eidetic memory "in-context," permanent structural memory "in-weights,"


The tiny tuxedo cat who became a naval hero

Popular Science

A 17-year-old British sailor saved Simon from the Hong Kong docks when he was likely a year old. Breakthroughs, discoveries, and DIY tips sent six days a week. One day in March of 1948, George Hickinbottom, a British sailor, was walking around the docks of Stonecutters Island in Hong Kong. When the 17-year-old spotted a small black-and-white tuxedo cat, barely out of kittenhood, he decided to smuggle the hungry, scrawny animal aboard his ship, the HMS . Hickinbottom didn't get in trouble.




Many-shot Jailbreaking

Neural Information Processing Systems

Longer contexts present a new attack surface for adversarial attacks. In search of a "fruit-fly" of long-context vulnerabilities, we study Many-shot Jailbreaking (MSJ; Figure 1), a simple yet effective and scalable jailbreak.