Goto

Collaborating Authors

 Large Language Model



VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images

Neural Information Processing Systems

Hence, we consider asking a VLM to provide the scientific name of the organism shown in a given image. There are two types of questions that we consider for this task. First, we consider open-ended questions, where we do not provide any answer choices (or options) to the VLM in the input prompt.






B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory

Neural Information Processing Systems

We leverage ideas from Stochastic Realization Theory to develop a class of models called B'MOJO to seamlessly combine eidetic and fading memory within an elementary composable module. The overall architecture can be used to implement models that can access short-term eidetic memory "in-context," permanent structural memory "in-weights,"


Probing the Decision Boundaries of In-context Learning in Large Language Models

Neural Information Processing Systems

Recent language models, such as GPT -3+ [Brown et al., 2020, Achiam et al., 2023], have demonstrated Recent attempts to understand in-context learning have focused on various aspects. On the practical side, research has investigated the impact of different factors on in-context learning.