Goto

Collaborating Authors

 Genre


OmniDraft: A cross-vocabulary, online adaptive drafter for on-device speculative decoding

Neural Information Processing Systems

Speculative decoding generally dictates having a small, efficient draft model that is either pretrained or distilled offline to a particular target model series, for instance, Llama or Qwen models. However, within online deployment settings, there are two major challenges: 1) usage of a target model that is incompatible with the draft model; 2) expectation of latency improvements over usage and time. In this work, we propose OmniDraft, a unified framework that enables a single draft model to operate with any target model and adapt dynamically to user data. We introduce an online n-gram cache with hybrid distillation fine-tuning to address the cross-vocabulary mismatch across draft and target models; and further improve decoding speed by leveraging adaptive drafting techniques. OmniDraft is particularly suitable for on-device LLM applications where model cost, efficiency and user customization are the major points of contention. This further highlights the need to tackle the above challenges and motivates the "one drafter for all" paradigm.


You're taking the p***! China unveils the world's first self-driving TOILET - and it can even clean itself

Daily Mail - Science & tech

Austin Metcalf's final moments caught on harrowing 911 call as cowardly killer seen trying to flee American woman, 28, suffers horrific medical emergency while on dream vacation... as her family faces five-figure bill to bring her home Reflecting Pool fiasco deepens as'American flag blue' paint PEELS OFF... and president has a stark theory why Astonishing full story of Colombia balcony'child abuse' video: Texan man falsely accused by lynch mob and branded'MAGA pedophile' by president finally has his say Cocaine scandal ripping the Hamptons apart: New York elite's dirty secret leaves mothers too afraid to let their children out... as police issue urgent warning Original SNL star Garrett Morris, 89, goes viral with eye-popping photo of his bulge: 'I can't unsee it' Taylor Swift's bombshell reconciliation phone call with Blake Lively: Insiders reveal every detail of wedding invite'olive branch' literally no one saw coming... and the actress has a dress picked out! Super-trendy hotspot restaurant loved by A-list celebrities is suddenly SEIZED over $1.2 million bill Little-known penis condition that SHORTENS manhood: Shockingly, 1 in 10 men have it... but most miss the signs until it's too late to reverse with easy cure: DR PETAR BAJIC Spencer Pratt shares photo of FBI crackdown on Skid Row'voter fraud': 'What do you notice in the background?' Jerry Hall's turning 70 - and she's invited Mick, his new love, and even her'marriage wrecker' rival to the party! Cristiano Ronaldo's fiancรฉe Georgina Rodriguez shows off her incredible figure in sexy swimwear as she poses for stunning shoot with Harper's Bazaar Spain Massive brawl breaks out between drunk shirtless men on river sandbar causing'severe' injuries as 6 including woman are arrested Even I was once overweight. So trust me, this 30 DAY detox plan will get you thin WITHOUT Ozempic... but if you want to stay skinny, you'll have to make one major sacrifice: JILLIAN MICHAELS The four mistakes that led to bungee tragedy on Skeleton Bridge: FRED KELLY saw the scene for himself, now he retraces the prelude to disaster. So was it really an accident?


Flutterly adorable! Schnauzer with incredibly long lashes is looking for a home - as delighted fans claim she has 'eyelashes of dreams'

Daily Mail - Science & tech

TV star mom, 46, who appeared on'quitting everything to change your life' show died in fire at luxury Caribbean beach resort that sent 1,700 tourists running for their lives Furious Trump hits back at Italian Prime Minister Meloni and gives her unusual'nickname' as their photo feud ramps up The'marry me' sex move that'll make even the most commitment-phobic of men beg to see you again... and it worked for THREE of my friends Take the 10-second finger exercise that may reveal your risk of dementia... and even protect against it'It feels like emotional blackmail': As Harry and Meghan announce return to Britain with Archie and Lilibet, insiders reveal fears about decision to bring children and'manipulation' of Royals The four mistakes that led to bungee tragedy on Skeleton Bridge: FRED KELLY saw the scene for himself, now he retraces the prelude to disaster. So was it really an accident? Dua Lipa stuns in a bespoke Chanel bridal gown and parties into the early hours as she shares the first pictures from her ยฃ1.5million Little-known penis condition that SHORTENS manhood: Shockingly, 1 in 10 men have it... but most miss the signs until it's too late to reverse with easy cure: DR PETAR BAJIC World Cup commentator denies making racist comment about Ciara live on air during USA's win over Australia Harrowing chain of events behind The Ring star's death at just 35 laid bare by doctors in agonizing detail... and how it could have been prevented Jelly Roll reveals divorce'plot twist' as he posts footage of post-split phone call with Bunnie XO Lindsey Vonn shows off remarkable progress in gym workout just four months after horrific injury: 'Makes me so happy' Taylor Swift's bombshell reconciliation phone call with Blake Lively: Insiders reveal every detail of wedding invite'olive branch' literally no one saw coming... and the actress has a dress picked out! Swedish actress, 81, was in TWO James Bond movies and also worked with Charlton Heston, who is she?


Accurately Predicting Protein Mutational Effects via a Hierarchical Many-Body Attention Network

Neural Information Processing Systems

Predicting changes in binding free energy ( G) is essential for understanding protein-protein interactions, which are critical in drug design and protein engineering. However, existing methods often rely on pre-trained knowledge and heuristic features, limiting their ability to accurately model complex mutation effects, particularly higher-order and many-body interactions. To address these challenges, we propose H3-DDG, a Hypergraph-driven Hierarchical network to capture Higherorder many-body interactions across multiple scales.


UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces

Neural Information Processing Systems

Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches, such as task specificity, regional dependency, and data sensitivity.


Estimating Hitting Times Locally At Scale

Neural Information Processing Systems

Hitting times provide a fundamental measure of distance in random processes, quantifying the expected number of steps for a random walk starting at node u to reach node v. They have broad applications across domains such as network centrality analysis, ranking and recommendation systems, and epidemiology. In this work, we develop local algorithms for estimating hitting times between a pair of vertices u,v without accessing the full graph, overcoming scalability issues of prior global methods. Our first algorithm uses the key insight that hitting time computations can be truncated at the meeting time of two independent random walks from uand v. This leads to an efficient estimator analyzed via the Kronecker product graph and Markov Chain Chernoff bounds. We also present an algorithm extending the work of Peng et al. [2021] that introduces a novel adaptation of the spectral cutoff technique to account for the asymmetry of hitting times. This adaptation captures the directionality of the underlying random walk and requires non-trivial modifications to ensure accuracy and efficiency. In addition to the algorithmic upper bounds, we also provide tight asymptotic lower bounds. We also reveal a connection between hitting time estimation and distribution testing, and validate our algorithms using experiments on both real and synthetic data1.


SNEAKDOOR: Stealthy Backdoor Attacks against Distribution Matching-based Dataset Condensation

Neural Information Processing Systems

Dataset condensation aims to synthesize compact yet informative datasets that1 retain the training efficacy of full-scale data, offering substantial gains in efficiency.2 Recent studies reveal that the condensation process can be vulnerable to backdoor3 attacks, where malicious triggers are injected into the condensation dataset, manipu-4 lating model behavior during inference. While prior approaches have made progress5 in balancing attack success rate and clean test accuracy, they often fall short in6 preserving stealthiness, especially in concealing the visual artifacts of condensed7 data or the perturbations introduced during inference. To address this challenge,8 we introduce SNEAKDOOR, which enhances stealthiness without compromising9 attack effectiveness. SNEAKDOOR exploits the inherent vulnerability of class deci-10 sion boundaries and incorporates a generative module that constructs input-aware11 triggers aligned with local feature geometry, thereby minimizing detectability. This12 joint design enables the attack to remain imperceptible to both human inspection13 and statistical detection. Extensive experiments across multiple datasets demon-14 strate that SNEAKDOOR achieves a compelling balance among attack success rate,15 clean test accuracy, and stealthiness, substantially improving the invisibility of both16 the synthetic data and triggered samples while maintaining high attack efficacy.17


AIhub monthly digest: June 2026 โ€“ biodiversity, resource allocation, and color metaphors

AIHub

Welcome to our monthly digest, where you can catch up with any AIhub stories you may have missed, peruse the latest news, recap recent events, and more. This month, we found out how foundation models are being used for conservation efforts, how AI can help with scarce resource allocation, and how color metaphors and LLMs can teach us about human cognition. We also went to ICRA and captured some footage of cutting-edge robots. In this latest interview in our AAAI Fellow series, we found out about Tanya Berger-Wolf's research developing a foundation model for biology, the insights this model can provide for conservation and protecting ecosystems, interesting collaborations over the years, and what the future has in store. In this interview, we chat to Sanmay Das, who was elected as a Fellow "for development of multiagent interaction mechanisms and learning techniques in the public interest, and for leadership service to the profession".


Robust Reinforcement Learning in Finance: Modeling Market Impact with Elliptic Uncertainty Sets

Neural Information Processing Systems

In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices. However, during deployment, these agents trade in live markets where their own transactions can shift asset prices, a phenomenon known as market impact.