smr
From Token to Action: State Machine Reasoning to Mitigate Overthinking in Information Retrieval
Lee, Dohyeon, Jeong, Yeonseok, Hwang, Seung-won
Chain-of-Thought (CoT) prompting enables complex reasoning in large language models (LLMs), including applications in information retrieval (IR). However, it often leads to overthinking, where models produce excessively long and semantically redundant traces with little or no benefit. We identify two key challenges in IR: redundant trajectories that revisit similar states and misguided reasoning that diverges from user intent. To address these, we propose State Machine Reasoning (SMR), a transition-based reasoning framework composed of discrete actions (Refine, Rerank, Stop) that support early stopping and fine-grained control. Experiments on the BEIR and BRIGHT benchmarks show that SMR improves retrieval performance (nDCG@10) by 3.4% while reducing token usage by 74.4%. It generalizes across LLMs and retrievers without requiring task-specific tuning, offering a practical alternative to conventional CoT reasoning. The code and details are available at https://github.com/ldilab/SMR.
UK needs more nuclear to power AI, says Amazon boss
French company EDF is currently building a giant new nuclear plant at Hinkley Point in Somerset and a decision to build another one at Sizewell in Suffolk is pending. "Why are data centre providers turning to nuclear? They will need a lot of energy, reliably," Mr Chisholm told the BBC. "Replication of Hinkley Point C, alongside the roll out of SMRs, can power Britain's digital economy." SMRs refers to small modular reactors which are the size of a football stadium as opposed to the size of a whole town, like Sizewell or Hinkley.
Google bets big on 'mini' nuclear reactors to feed its AI demands
Google is officially putting its weight behind advanced "mini" nuclear reactors in an effort to produce new clean to meet growing AI energy demands. On Tuesday, the company announced an agreement with California-based small nuclear reactor (SMR) startup Kairos Power to commission the development of six or seven reactors that could add 500 megawatts of clean energy to the US electrical grid within the next decade. Google's buy-in represents the biggest investment for the experimental new reactor type from a tech company and could play a key in making so-called next-generation nuclear commercially viable. The deal is part of a broader embrace of nuclear power by tech giants who are frantically searching for ways to fuel their increasing energy consumption while attempting to stick to their climate goals. In a blog post, Google said it expects the first of Kairos reactors to come online as early as 2030, with the other five six operational by 2035.
Google goes NUCLEAR: Tech giant will use nuclear reactors to generate the vast amounts of energy needed to power its AI data centres
With its Gemini chatbot and Pixel AI phone software, it's fair to say Google has an obsessive focus on artificial intelligence. But all that advanced computational power requires millions of computers, known as'servers', housed inside data centres across the world that operate 24/7. Now, in an attempt to cater to its vast AI needs, Google is going nuclear. The tech giant has signed a deal with California-based nuclear firm Kairos Power to build new nuclear reactors to supply its US data centres with energy. Although the location of these reactors is yet to be revealed, Google said the first will be operational in 2030, with more to follow by 2035.
SMR: State Memory Replay for Long Sequence Modeling
Qi, Biqing, Gao, Junqi, Zhang, Kaiyan, Li, Dong, Liu, Jianxing, Wu, Ligang, Zhou, Bowen
Despite the promising performance of state space models (SSMs) in long sequence modeling, limitations still exist. Advanced SSMs like S5 and S6 (Mamba) in addressing non-uniform sampling, their recursive structures impede efficient SSM computation via convolution. To overcome compatibility limitations in parallel convolutional computation, this paper proposes a novel non-recursive non-uniform sample processing strategy. Theoretical analysis of SSMs through the lens of Event-Triggered Control (ETC) theory reveals the Non-Stable State (NSS) problem, where deviations from sampling point requirements lead to error transmission and accumulation, causing the divergence of the SSM's hidden state. Our analysis further reveals that adjustments of input sequences with early memories can mitigate the NSS problem, achieving Sampling Step Adaptation (SSA). Building on this insight, we introduce a simple yet effective plug-and-play mechanism, State Memory Replay (SMR), which utilizes learnable memories to adjust the current state with multi-step information for generalization at sampling points different from those in the training data. This enables SSMs to stably model varying sampling points. Experiments on long-range modeling tasks in autoregressive language modeling and Long Range Arena demonstrate the general effectiveness of the SMR mechanism for a series of SSM models.
Off-Policy RL Algorithms Can be Sample-Efficient for Continuous Control via Sample Multiple Reuse
Lyu, Jiafei, Wan, Le, Lu, Zongqing, Li, Xiu
Sample efficiency is one of the most critical issues for online reinforcement learning (RL). Existing methods achieve higher sample efficiency by adopting model-based methods, Q-ensemble, or better exploration mechanisms. We, instead, propose to train an off-policy RL agent via updating on a fixed sampled batch multiple times, thus reusing these samples and better exploiting them within a single optimization loop. We name our method sample multiple reuse (SMR). We theoretically show the properties of Q-learning with SMR, e.g., convergence. Furthermore, we incorporate SMR with off-the-shelf off-policy RL algorithms and conduct experiments on a variety of continuous control benchmarks. Empirical results show that SMR significantly boosts the sample efficiency of the base methods across most of the evaluated tasks without any hyperparameter tuning or additional tricks.
SMR: Medical Knowledge Graph Embedding for Safe Medicine Recommendation
Gong, Fang, Wang, Meng, Wang, Haofen, Wang, Sen, Liu, Mengyue
Most of the existing medicine recommendation systems that are mainly based on electronic medical records (EMRs) are significantly assisting doctors to make better clinical decisions benefiting both patients and caregivers. Even though the growth of EMRs is at a lighting fast speed in the era of big data, content limitations in EMRs restrain the existed recommendation systems to reflect relevant medical facts, such as drug-drug interactions. Many medical knowledge graphs that contain drug-related information, such as DrugBank, may give hope for the recommendation systems. However, the direct use of these knowledge graphs in the systems suffers from robustness caused by the incompleteness of the graphs. To address these challenges, we stand on recent advances in graph embedding learning techniques and propose a novel framework, called Safe Medicine Recommendation (SMR), in this paper. Specifically, SMR first constructs a high-quality heterogeneous graph by bridging EMRs (MIMIC-III) and medical knowledge graphs (ICD-9 ontology and DrugBank). Then, SMR jointly embeds diseases, medicines, patients, and their corresponding relations into a shared lower dimensional space. Finally, SMR uses the embeddings to decompose the medicine recommendation into a link prediction process while considering the patient's diagnoses and adverse drug reactions. To our best knowledge, SMR is the first to learn embeddings of a patient-disease-medicine graph for medicine recommendation in the world. Extensive experiments on real datasets are conducted to evaluate the effectiveness of proposed framework.
Generalizability of predictive models for intensive care unit patients
Johnson, Alistair E. W., Pollard, Tom J., Naumann, Tristan
A large volume of research has considered the creation of predictive models for clinical data; however, much existing literature reports results using only a single source of data. In this work, we evaluate the performance of models trained on the publicly-available eICU Collaborative Research Database. We show that cross-validation using many distinct centers provides a reasonable estimate of model performance in new centers. We further show that a single model trained across centers transfers well to distinct hospitals, even compared to a model retrained using hospital-specific data. Our results motivate the use of multi-center datasets for model development and highlight the need for data sharing among hospitals to maximize model performance.
Frank-Wolfe Algorithm for Exemplar Selection
Cheng, Gary, Askari, Armin, Ghaoui, Laurent El, Ramchandran, Kannan
In this paper, we consider the problem of selecting representatives from a data set for arbitrary supervised/unsupervised learning tasks. We identify a subset $S$ of a data set $A$ such that 1) the size of $S$ is much smaller than $A$ and 2) $S$ efficiently describes the entire data set, in a way formalized via auto-regression. The set $S$, also known as the exemplars of the data set $A$, is constructed by solving a convex auto-regressive version of dictionary learning where the dictionary and measurements are given by the data matrix. We show that in order to generate $|S| = k$ exemplars, our algorithm, Frank-Wolfe Sparse Representation (FWSR), only requires $\approx k$ iterations with a per-iteration cost that is quadratic in the size of $A$, an order of magnitude faster than state of the art methods. We test our algorithm against current methods on 4 different data sets and are able to outperform other exemplar finding methods in almost all scenarios. We also test our algorithm qualitatively by selecting exemplars from a corpus of Donald Trump and Hillary Clinton's twitter posts.
Submodular relaxation for inference in Markov random fields
The problem of inference in a Markov random field (MRF) arises in many applied domains, e.g. in machine learning, computer vision, natural language processing, etc. In this paper we focus on one important type of inference: maximum a posteriori (MAP) inference, often referred to as MRF energy minimization. Inference of this type is a combinatorial optimization problem, i.e. an optimization problem with the finite domain. The most studied case of MRF energy minimization is the situation when the energy can be represented as a sum of terms (potentials) that depend on only one or two variables each (unary and pairwise potentials). In this setting the energy is said to be defined by a graph where the nodes correspond to the variables and the edges to the pairwise potentials. Minimization of energies defined on graphs in known to be NPhard in general [8] but can be done exactly in polynomial time in a number of special cases, e.g. if the graph defining the energy is acyclic [36] or if the energy is submodular in standard [28] or multi-label sense [10]. One way to go beyond pairwise potentials is to add higher-order summands to the energy. For example, Kohli et al. [23] and Ladický et al. [32] use high-order potentials based on superpixels (image regions) for semantic image segmentation; Delong et al. [11] use label cost potentials for geometric model fitting tasks. To be tractable, high-order potentials need to have a compact representation.