Goto

Collaborating Authors

 backbone


Tech stock rout, driven by US AI fears, continues in Asian trading

Al Jazeera

A tech stock rout that began overnight in the United States has persisted in Asian trading. Market authorities in South Korea paused trading on Friday as prices plunged across the region. Global markets have been rattled by a sharp fall in the trading price of tech stocks, which is driven by fears that the Democrats' victory in the US midterm elections will increase regulatory scrutiny of AI and slow the country's data centre build-out. Indices in South Korea and Taiwan plunged more than 8 percent after the opening bell, before cutting losses as authorities scrambled to stem the selling. Wall Street's volatility "fear gauge" soared overnight on Thursday and the tech-focused Nasdaq sank 5.5 percent, wiping $3 trillion off S&P 500 firms, as investors fretted that the Democrats could put the brakes on the AI boom being encouraged by President Donald Trump.


Muscle coordination can be mimicked by electric motors – it could lead to improved robots

Robohub

People often take their muscles for granted. They pick up a bag, tighten a grip, climb a hill, hold a cup of coffee and the body quietly adjusts force, speed and position without the person ever thinking about it. Muscle turns chemical energy into movement . It is able to produce force smoothly and reliably, even though it is built from huge numbers of tiny molecular components. When the load changes, muscles don't simply wobble or fail.


The ultimate retro flex for your phone: Backbone unveils blind-box 25th Anniversary Xbox controllers

Mashable

Look Up Trending Now Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Say More Mashable Selects Mashable Voices Safety Net Creator Hub Versus Gift Ideas For Everyone On Your List Switch Off In My Bag All Series Three retro colorways, one mystery box, zero control over which one you get. Soumya is a deals writer who covers consumer tech, shopping deals, and the products people use every day. With experience writing about everything from AI tools and software to smartphones and home gadgets, she enjoys breaking down product research into clear, useful recommendations. When she's not tracking deals, she's usually comparing products, digging through reviews, and figuring out what actually makes a purchase worth it. All products featured here are independently selected by our editors and writers.


Prototype Language Models

arXiv.org Machine Learning

Knowing which training examples drive outputs is fundamental to auditing, correcting, and understanding language models, yet for modern LLMs this remains expensive, approximate, and largely post-hoc. Standard language models generate tokens through a dense network pathway, causing training data's influence to be distributed across parameters rather than organized along explicit, traceable components. We introduce a prototype language model architecture, Prototypes for Interpretable Sequence Modeling (PRISM), that forms each prediction via a sparse, non-negative mixture of learned prototypes, trained with clustering objectives that anchor each prototype to coherent neighborhoods of training examples. Across architectures from 130M to 1.6B parameters trained on up to 50B tokens, prototype language models either surpass or remain within 2.5 percentage points on average downstream accuracy of matched dense baselines. We show that sparse prototype structure localizes curvature in the loss landscape, yielding a more tractable Hessian and enabling training data attribution that is ~500x faster than post hoc baselines when consuming equivalent memory. Calibrating linear prototype controllers can improve downstream accuracy by roughly 3 points while tracing those corrections back to training neighborhoods, and targeted prototype suppression can remove model behaviors without finetuning or measurable loss in generation quality.


Efficient Adaptive Data Acquisition via Pretrained Belief Representations

arXiv.org Machine Learning

Learning effective policies for adaptive data acquisition remains challenging: posterior-based methods rely on surrogate models and posterior approximations that can be misspecified or biased, while direct policy-learning methods map from historical observations and fail to exploit available model representations, making learning harder. We introduce policy learning with belief representations (POLAR), based on the insight that optimal data acquisition depends on the observation history only through a sufficient belief state. Specifically, POLAR decouples representation learning from policy learning by leveraging pretrained predictive foundation models as belief-state encoders, training a policy head on top of their representations. This yields a simple, unified amortised policy learning framework for Bayesian experimental design, Bayesian optimisation, and active learning, differing only in the task-specific utility used to train the policy. Empirically, we find that POLAR outperforms state-of-the-art amortised methods across diverse tasks while requiring far fewer training samples, demonstrating a significant step in the scalability and efficiency of amortised data acquisition.


Transformer brain encoders explain human high-level visual responses

Neural Information Processing Systems

A major goal of neuroscience is to understand brain computations during visual processing in naturalistic settings. A dominant approach is to use image-computable deep neural networks trained with different task objectives as a basis for linear encoding models. However, in addition to requiring estimation of a large number of linear encoding parameters, this approach ignores the structure of the feature maps both in the brain and the models. Recently proposed alternatives factor the linear mapping into separate sets of spatial and feature weights, thus finding static receptive fields for units, which is appropriate only for early visual areas. In this work, we employ the attention mechanism used in the transformer architecture to study how retinotopic visual features can be dynamically routed to category-selective areas in high-level visual processing. We show that this computational motif is significantly more powerful than alternative methods in predicting brain activity during natural scene viewing, across different feature basis models and modalities. We also show that this approach is inherently more interpretable as the attentionrouting signals for different high-level categorical areas can be easily visualized for any input image. Given its high performance at predicting brain responses to novel images, the model deserves consideration as a candidate mechanistic model of how visual information from retinotopic maps is routed in the human brain based on the relevance of the input content to different category-selective regions.


Relieving the Over-Aggregating Effect in Graph Transformers

Neural Information Processing Systems

Graph attention has demonstrated superior performance in graph learning tasks. However, learning from global interactions can be challenging due to the large number of nodes. In this paper, we discover a new phenomenon termed overaggregating. Over-aggregating arises when a large volume of messages is aggregated into a single node with less discrimination, leading to the dilution of the key messages and potential information loss. To address this, we propose Wideformer, a plug-and-play method for graph attention. Wideformer divides the aggregation of all nodes into parallel processes and guides the model to focus on specific subsets of these processes. The division can limit the input volume per aggregation, avoiding message dilution and reducing information loss.


Meta-Learning an In-Context Transformer Model of Human Higher Visual Cortex

Neural Information Processing Systems

Understanding functional representations within higher visual cortex is a fundamental question in computational neuroscience. While artificial neural networks pretrained on large-scale datasets exhibit striking representational alignment with human neural responses, learning image-computable models of visual cortex relies on individual-level, large-scale fMRI datasets. The necessity for expensive, time-intensive, and often impractical data acquisition limits the generalizability of encoders to new subjects and stimuli. BraInCoRL uses incontext learning to predict voxelwise neural responses from few-shot examples without any additional finetuning for novel subjects and stimuli.


SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs

arXiv.org Machine Learning

Agentic LLMs must continuously decide whether newly extracted facts should be added, merged with existing memories, or ignored, yet prior work has focused more on retrieval and storage than on principled write-side control. We frame memory evolution as a novelty-detection problem and propose SAGE, a Spherical Adaptive Gate for memory Evolution that scores candidate facts with a von Mises-Fisher-based density estimator over memory embeddings and routes them with an adaptive threshold that tracks memory-store geometry. SAGE resolves clearly novel facts as ADD, clearly redundant facts as NOOP, and sends only uncertain cases to an LLM merge step, reducing expensive write-time reasoning. On LoCoMo, SAGE achieves the best average token-F1 against Mem0 on all seven open-weight backbone comparisons, while on GPT-4o-mini it reduces add-phase API cost by 3.4$\times$ and add-phase latency by 2.5$\times$ with only a small average judge-score gap. As a drop-in binary gate for A-Mem, SAGE skips roughly 16-18% of LLM calls across five models with minimal quality change on open-weight backbones. These results suggest that novelty-aware write control is a practical lever for improving both memory quality and system efficiency in long-term agentic memory. The source code for our approach is accessible at https://github.com/swang1024/SAGE.


EnzyControl: Adding Functional and Substrate-Specific Control for Enzyme Backbone Generation

Neural Information Processing Systems

Designing enzyme backbones with substrate-specific functionality is a critical challenge in computational protein engineering. Current generative models excel in protein design but face limitations in binding data, substrate-specific control, and flexibility for de novo enzyme backbone generation. To address this, we introduce EnzyBind, a dataset with 11,100 experimentally validated enzyme-substrate pairs specifically curated from PDBbind. Building on this, we propose EnzyControl, a method that enables functional and substrate-specific control in enzyme backbone generation. Our approach generates enzyme backbones conditioned on MSAannotated catalytic sites and their corresponding substrates, which are automatically extracted from curated enzyme-substrate data. At the core of EnzyControl is EnzyAdapter, a lightweight, modular component integrated into a pretrained motifscaffolding model, allowing it to become substrate-aware. A two-stage training paradigm further refines the model's ability to generate accurate and functional enzyme structures. Experiments show that our EnzyControl achieves the best performance across structural and functional metrics on EnzyBind and EnzyBench benchmarks, with particularly notable improvements of 13% in designability and 13% in catalytic efficiency compared to the baseline models.