Goto

Collaborating Authors

 Government


B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory

Neural Information Processing Systems

We leverage ideas from Stochastic Realization Theory to develop a class of models called B'MOJO to seamlessly combine eidetic and fading memory within an elementary composable module. The overall architecture can be used to implement models that can access short-term eidetic memory "in-context," permanent structural memory "in-weights,"


The tiny tuxedo cat who became a naval hero

Popular Science

A 17-year-old British sailor saved Simon from the Hong Kong docks when he was likely a year old. Breakthroughs, discoveries, and DIY tips sent six days a week. One day in March of 1948, George Hickinbottom, a British sailor, was walking around the docks of Stonecutters Island in Hong Kong. When the 17-year-old spotted a small black-and-white tuxedo cat, barely out of kittenhood, he decided to smuggle the hungry, scrawny animal aboard his ship, the HMS . Hickinbottom didn't get in trouble.




Many-shot Jailbreaking

Neural Information Processing Systems

Longer contexts present a new attack surface for adversarial attacks. In search of a "fruit-fly" of long-context vulnerabilities, we study Many-shot Jailbreaking (MSJ; Figure 1), a simple yet effective and scalable jailbreak.