Goto

Collaborating Authors

 Technology


When No Paths Lead to Rome: Benchmarking Systematic Neural Relational Reasoning

Neural Information Processing Systems

Designing models that can learn to reason in a systematic way is an important and long-standing challenge. In recent years, a wide range of solutions have been proposed for the specific case of systematic relational reasoning, including Neuro-Symbolic approaches, variants of the Transformer architecture, and specialized Graph Neural Networks. However, existing benchmarks for systematic relational reasoning focus on an overly simplified setting, based on the assumption that reasoning can be reduced to composing relational paths. In fact, this assumption is hard-baked into the architecture of several recent models, leading to approaches that can perform well on existing benchmarks but are difficult to generalize to other settings. To support further progress in the field of systematic relational reasoning with neural networks, we introduce a new benchmark that adds several levels of difficulty, requiring models to go beyond path-based reasoning.


Continuous Subspace Optimization for Continual Learning

Neural Information Processing Systems

Continual learning aims to learn multiple tasks sequentially while preserving prior knowledge, but faces the challenge of catastrophic forgetting when adapting to new tasks. Recently, approaches leveraging pre-trained models have gained increasing popularity in mitigating this issue, due to the strong generalization ability of foundation models. To adjust pre-trained models for new tasks, existing methods usually employ low-rank adaptation, which restricts parameter updates to a fixed low-rank subspace. However, constraining the optimization space inherently compromises the model's learning capacity, resulting in inferior performance. To address this limitation, we propose Continuous Subspace Optimization for Continual Learning (CoSO) to fine-tune the model in a series of subspaces rather than a single one. These sequential subspaces are dynamically determined through the singular value decomposition of the gradients.


Fast MRI for All: Bridging Access Gaps by Training without Raw Data

Neural Information Processing Systems

Physics-driven deep learning (PD-DL) approaches have become popular for improved reconstruction of fast magnetic resonance imaging (MRI) scans. Though PD-DL offers higher acceleration rates than existing clinical fast MRI techniques, their use has been limited outside specialized MRI centers. A key challenge is generalization to rare pathologies or different populations, noted in multiple studies, with fine-tuning on target populations suggested for improvement. However, current approaches for PD-DL training require access to raw k-space measurements, which is typically only available at specialized MRI centers that have research agreements for such data access. This is especially an issue for rural and under-resourced areas, where commercial MRI scanners only provide access to a final reconstructed image.


Beyond Benign Overfitting in Nadaraya-Watson Interpolators

Neural Information Processing Systems

In recent years, there has been much interest in understanding the generalization behavior of interpolating predictors, which overfit on noisy training data. Whereas standard analyses are concerned with whether a method is consistent or not, recent observations have shown that even inconsistent predictors can generalize well. In this work, we revisit the classic interpolating Nadaraya-Watson (NW) estimator (also known as Shepard's method), and study its generalization capabilities through this modern viewpoint. In particular, by varying a single bandwidth-like hyperparameter, we prove the existence of multiple overfitting behaviors, ranging non-monotonically from catastrophic, through benign, to tempered. Our results highlight how even classical interpolating methods can exhibit intricate generalization behaviors. In addition, for the purpose of tuning the hyperparameter, the results suggest that over-estimating the intrinsic dimension of the data is less harmful than under-estimating it. Numerical experiments complement our theory, demonstrating the same phenomena.


Exploring Data Scaling Trends and Effects in Reinforcement Learning from Human Feedback

Neural Information Processing Systems

Reinforcement Learning from Human Feedback (RLHF) is essential for aligning large language models (LLMs) with human preferences and values. While recent research has primarily focused on algorithmic advancements--such as reducing computational overhead or strengthening reward models to mitigate reward hacking--the critical role of prompt-data construction and its scalability has received comparatively less attention. In this paper, we address this gap by systematically exploring data-driven bottlenecks that currently hinder RLHF performance scaling, focusing specifically on the challenges posed by reward hacking and decreasing response diversity. To mitigate reward hacking, we introduce a hybrid reward system combining reasoning task verifiers (RTV) and a generative reward model (GenRM). This approach not only exhibits enhanced resistance to reward hacking, but also enables accurate assessment of responses against clearly defined ground-truth solutions. Additionally, in order to ensure response diversity and enhance learning effectiveness, we propose a novel prompt-selection method named \textbf{Pre-PPO}, explicitly identifying training prompts that are inherently challenging and thus less prone to reward hacking.


Engadget Podcast: WWDC 2026 thoughts from Apple Park

Engadget

We dive into our initial thoughts on Siri AI and Tim Cook's legacy. Executive editor Cherlynn Low is joined by tech editor Daniel Howley, senior staff writer Brenda Stolyar and Judner Aura (also known as uravgconsumer) on this special episode of the Engadget Podcast. The four talk about what really mattered at WWDC 2026, the delayed gratification of Siri AI as well as what it all means for Tim Cook's legacy.


Pairing nine World Cup contenders with their college football counterparts ahead of 2026 tournament

FOX News

Trump tears into Stephen A Smith as feud grows: 'Arrogant fool, a low IQ individual' Orioles' Leody Taveras suffers most embarrassing strikeout of the pitch clock era against his former team'World's Best Ex-Girlfriend' Morgan Riddle done dating athletes, Nikki Spoelstra's selfies for haters & malls Dodgers catcher Dalton Rushing executes a slide so illegal it would've made the 1980s proud The magic of Omaha: Why the College World Series is unlike anything else in sports that's worth the trip Kyle Busch's son suffers heartbreak in emotional return to racing after father's stunning death Why the under 4.5 through five innings is the play in Nationals-Giants with Foster Griffin facing Robbie Ray Dana White brings legendary stuntman Travis Pastrana's dirt bike backflip to White House USMNT legend Landon Donovan talks World Cup, American soccer's influence overseas during Raising Cane's shift Athletics wild first game in Las Vegas leads to 29 runs, 11 home runs in ominous sign for area's MLB future LIV Golf CEO refuses to guarantee circuit's remaining events will go on as scheduled with awkward sales pitch Golf WAG Jena Sims gets excited talking about meeting Travis Kelce and reveals that he's her'hall pass' Steve Doocy traces Walmart's origins in Arkansas Pompeo warns Iranian regime will'not go away' after US helicopter downed House approves resolution to limit Trump's war powers Trump's reveals new details on Iran drone attack downing US Apache helicopter Trump warns Iran will'PAY THE PRICE' after taking too long'Fox & Friends' covers the upcoming FIFA World Cup 2026, counting down to the global soccer event. Former USMNT Midfielder Stu Holden joins live from Audi Field to discuss the Capitol Cup congressional soccer match. Holden highlights the growing excitement for soccer in the U.S. and the national team's underdog chances in the World Cup before taking part in a lighthearted penalty-kick challenge. When it comes to fandom, few can rival international soccer fanatics. It's hard to find a group of people more fervent than the ones who support a World Cup powerhouse.


Brain removal likely used in Iron Age Scottish burial

Popular Science

A woman's 2,000-year-old skeleton also shows signs of limb sharpening. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. Biological remains typically don't survive the region's moist, deteriorating soil. Breakthroughs, discoveries, and DIY tips sent six days a week. By signing up, you confirm you are 16+, will receive newsletters and promotional content and agree to our Terms of Use and acknowledge the data practices in our Privacy Policy .


Trump tears into Stephen A Smith as feud grows: 'Arrogant fool, a low IQ individual'

FOX News

Cardi B claims Donald Trump's attendance brought a'dark' energy to NBA Finals Game 3 Orioles' Leody Taveras suffers most embarrassing strikeout of the pitch clock era against his former team'World's Best Ex-Girlfriend' Morgan Riddle done dating athletes, Nikki Spoelstra's selfies for haters & malls Dodgers catcher Dalton Rushing executes a slide so illegal it would've made the 1980s proud The magic of Omaha: Why the College World Series is unlike anything else in sports that's worth the trip Kyle Busch's son suffers heartbreak in emotional return to racing after father's stunning death Why the under 4.5 through five innings is the play in Nationals-Giants with Foster Griffin facing Robbie Ray Dana White brings legendary stuntman Travis Pastrana's dirt bike backflip to White House USMNT legend Landon Donovan talks World Cup, American soccer's influence overseas during Raising Cane's shift Athletics wild first game in Las Vegas leads to 29 runs, 11 home runs in ominous sign for area's MLB future LIV Golf CEO refuses to guarantee circuit's remaining events will go on as scheduled with awkward sales pitch Steve Doocy explores Bentonville, Arkansas, the'Mountain Bike Capital of the World' Steve Doocy traces Walmart's origins in Arkansas Pompeo warns Iranian regime will'not go away' after US helicopter downed House approves resolution to limit Trump's war powers Trump's reveals new details on Iran drone attack downing US Apache helicopter OutKick Sports Trump tears into Stephen A Smith as feud grows: 'Arrogant fool, a low IQ individual' The ESPN host questioned Trump's policies after the president first mocked his aptitude for political office President Donald Trump responded to ESPN's Stephen A Smith's critique about showing up to the New York Knicks' NBA Finals game. President Donald Trump took another swipe at ESPN personality Stephen A. Smith as the two traded barbs over the president's attendance at the New York Knicks' NBA Finals game. Smith initially said Trump's attendance would be a detriment to NBA fans and the city. Trump was asked to respond to Smith's comments by Fox News Digital/OutKick on Monday night. The president said he wasn't sure that Smith had the aptitude or a high IQ to run for office.


Improved Confidence Regions and Optimal Algorithms for Online and Offline Linear MNL Bandits

Neural Information Processing Systems

In this work, we consider the data-driven assortment optimization problem under the linear multinomial logit(MNL) choice model. We first establish a improved confidence region for the maximum likelihood estimator (MLE) of the $d$-dimensional linear MNL likelihood function that removes the explicit dependency on a problem-dependent parameter $\kappa^{-1}$ in previous result (Oh and Iyengar, 2021), which scales exponentially with the radius of the parameter set. Building on the confidence region result, we investigate the data-driven assortment optimization problem in both offline and online settings.