Goto

Collaborating Authors

 early decision


EmergentGraphicalConventionsin aVisualCommunicationGame

Neural Information Processing Systems

Due to itsiconic nature (i.e., perceptual resemblance to or natural association with the referent), drawings serve as a powerful tool to communicate concepts transcending language barriers (Fay et al., 2014). In fact, we humans started to use drawings to convey messages dating back to 40,000-60,000 years ago (Hoffmann et al., 2018; Hawkins et al., 2019).


More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models

Tian, Xinyu, Zou, Shu, Yang, Zhaoyuan, He, Mengqi, Waschkowski, Fabian, Wesemann, Lukas, Tu, Peter, Zhang, Jing

arXiv.org Artificial Intelligence

Reasoning has emerged as a pivotal capability in Large Language Models (LLMs). Through Reinforcement Learning (RL), typically Group Relative Policy Optimization (GRPO), these models are able to solve complex tasks such as mathematics and code generation. Building on these advances, recent research has sought to extend reasoning to Vision-Language Models (VLMs), yielding promising results across diverse visual tasks. Despite this progress, our study uncovers the dual nature of multimodal reasoning: while it substantially enhances logical inference and facilitates performance on challenging problems, it may gradually impair perceptual grounding, leading to recognition failures on otherwise basic visual questions. Through further analysis, we attribute this phenomenon to visual forgetting, wherein prolonged reasoning causes the model to increasingly disregard visual input. To address this, we propose Vision-Anchored Policy Optimization (VAPO), a simple yet effective method that explicitly steers the reasoning process toward visually grounded trajectories. Our result model, VAPO-Thinker-7B, significantly strengthens the model's reliance on visual information and achieves new state-of-the-art results on a wide range of established benchmarks. Project page: https://xytian1008.github.io/VAPO/


ml_edm package: a Python toolkit for Machine Learning based Early Decision Making

Renault, Aurélien, Achenchabe, Youssef, Bertrand, Édouard, Bondu, Alexis, Cornuéjols, Antoine, Lemaire, Vincent, Dachraoui, Asma

arXiv.org Artificial Intelligence

\texttt{ml\_edm} is a Python 3 library, designed for early decision making of any learning tasks involving temporal/sequential data. The package is also modular, providing researchers an easy way to implement their own triggering strategy for classification, regression or any machine learning task. As of now, many Early Classification of Time Series (ECTS) state-of-the-art algorithms, are efficiently implemented in the library leveraging parallel computation. The syntax follows the one introduce in \texttt{scikit-learn}, making estimators and pipelines compatible with \texttt{ml\_edm}. This software is distributed over the BSD-3-Clause license, source code can be found at \url{https://github.com/ML-EDM/ml_edm}.

  Country: Europe > Portugal > Porto > Porto (0.05)
  Genre: Research Report (0.50)