Education
Contribution of task-irrelevant stimuli to drift of neural representations
Biological and artificial learners are inherently exposed to a stream of data and experience throughout their lifetimes and must constantly adapt to, learn from, or selectively ignore the ongoing input. Recent findings reveal that, even when the performance remains stable, the underlying neural representations can change gradually over time, a phenomenon known as representational drift. Studying the different sources of data and noise that may contribute to drift is essential for understanding lifelong learning in neural systems. However, a systematic study of drift across architectures and learning rules, and the connection to task, are missing. Here, in an online learning setup, we characterize drift as a function of data distribution, and specifically show that the learning noise induced by task-irrelevant stimuli, which the agent learns to ignore in a given context, can create long-term drift in the representation of task-relevant stimuli. Using theory and simulations, we demonstrate this phenomenon both in Hebbian-based learning---Oja's rule and Similarity Matching---and in stochastic gradient descent applied to autoencoders and a supervised two-layer network. We consistently observe that the drift rate increases with the variance and the dimension of the data in the task-irrelevant subspace.
Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracing
We introduce ExRec, a general framework for personalized exercise recommendation with semantically-grounded knowledge tracing. Our method builds on the observation that existing exercise recommendation approaches simulate student performance via knowledge tracing (KT) but they often overlook two key aspects: (a) the semantic content of questions and (b) the sequential, structured progression of student learning. To address this, our ExRec presents an end-to-end pipeline, from annotating the KCs of questions and learning their semantic representations to training KT models and optimizing several reinforcement learning (RL) methods. Moreover, we improve standard Q-learning-based continuous RL methods via a tailored model-based value estimation (MVE) approach that directly leverages the components of KT model in estimating cumulative knowledge improvement.
Generalization in Nonlinear Least Squares via Learned Feature Geometry
Kharel, Ayub, Kuzborskij, Ilja, Rebeschini, Patrick, Abbasi-Yadkori, Yasin
We study the generalization of ridge-regularized nonlinear least-squares models via on-average algorithmic stability, deriving error bounds for local minimizers in terms of a data-dependent effective dimension that reflects the geometry of the gradient model at the trained parameters, through the empirical Jacobian Gram matrix and a residual-curvature term. In the linear case, where the curvature term vanishes, this recovers the classical effective dimension of the Jacobian kernel covariance, but evaluated at the trained model rather than at initialization as is typical in neural tangent kernel analyses. We further bound this effective dimension via covering complexity of the gradient features, leading to guarantees that depend on learned geometry rather than parameter count. In particular, for manifold-supported data and piecewise Lipschitz Jacobians, the bounds scale with intrinsic dimension, while for one-hidden-layer ReLU networks, the mechanism can be made explicit through counts of activation-stable regions. Experiments on synthetic manifolds, clustered distributions, and benchmark datasets illustrate trained-Jacobian compression, the tightness of the residual-curvature linearization, and agreement between the stability bound and observed generalization gaps. A key feature of our bounds is the simplicity of their derivation, which follows from first principles using the Brascamp-Lieb inequality under strongly log-concave noise.
Robot Talk Episode 159 – Robot sensing and manipulation, with Maria Koskinopoulou
Maria Koskinopoulou is an Assistant Professor in Robotics and Computer Vision at Heriot-Watt University. Her research interests include robotic manipulation, perception, robot vision, medical robotics, human-robot interaction, and machine learning. She is involved in major UKRI and EU-funded research projects advancing robotic manipulation, surgical and underwater robotics, autonomous assembly, and waste sorting. Robot Talk is a weekly podcast that explores the exciting world of robotics, artificial intelligence and autonomous machines. Robot Talk is a weekly podcast that explores the exciting world of robotics, artificial intelligence and autonomous machines.
Design tweaks promote responsible AI use for environmental protection, research shows
Artificial intelligence systems that ask users to pause to consider AI's energy consumption and environmental impacts are likely to reduce unnecessary AI use, new research by Oregon State University suggests. The findings, published in Science Communication, are important as AI is already using electricity on scales that can be meaningfully compared to households, factories and towns. For example, the electricity needed to train a large language model would power 120 homes for a year, the researchers note; one AI-generated image has roughly the same energy cost as charging a smartphone. With about 85% of the world's energy still coming from fossil fuels, every megawatt-hour that can be carved from AI's electricity profile is significant, says the study's leader, Cheng "Chris" Chen of the OSU College of Liberal Arts. "Despite AI's substantial environmental impacts, information about those impacts is rarely disclosed or effectively communicated to everyday users of AI systems," said Chen, assistant professor in the School of Communication.
Britain is crazy for SALMON: Demand for the fish skyrockets as health-conscious TikTokers flock to stock up
'Record the faces': Tense moment NBA boss gives VERY honest take on Trump attending Knicks game Leaked transcript of UNAIRED 60 Minutes interview exposes REAL reason'callous' CBS star Scott Pelley'deserved to be fired' Disgraceful texts'hot' teacher sent boy, 17, who she had illegal sex with where she moaned about her HUSBAND Everyone always said I cleared my throat a lot. But then I developed shoulder pain and doctors discovered the sinister cause... the world's deadliest cancer. Don't leave it too late like I did Outrage as Netanyahu is caught SPYING on Trump's Iran negotiators... as JD Vance reveals a chilling truth about Israel White couple gave birth to'non-Caucasian' baby. Parents were told son, 7, had ADHD... not realizing he was battling terrifying disease that has now left him BLIND'Great' mom, 32, tried to gas herself and her three young kids to death after inviting them to'popcorn sleepover' in car, prosecutors allege Medical student, 24, died by suicide in his white coat a day after he was suspended for alleged'inappropriate' behavior towards female patient, lawsuit alleges, as his heartbreaking goodbye note to parents is revealed Karmelo Anthony's parents seen leaving the courtroom in tears just before son's defense team pulls shock move Grim-faced former Louisiana mayor Misty Roberts arrives in court for sentencing after being found guilty of having sex with son's teenage friend Mother died during tummy tuck and Brazilian butt lift after clinic staff failed to hold'slow' elevator for EMTs, report alleges Gaming influencer Alex Cimo dies'very suddenly' aged 32 just a month after'refusing to accept his fate' The porn-fuelled fantasy middle-class husbands are desperate to try with their wives... and it almost always ends in divorce: JANA HOCKING All the backstage gossip from Miami Swim Week: Insider exposes'catty' VIP's diva demands... STEALING... and'morbidly embarrassing' celeb moment everyone is whispering about Girl, 13, mistakenly told she was DYING after Oregon hospital staff made jaw-dropping surgical mistake, parents' $17m lawsuit alleges Mother's final words before she was shot dead'by new husband' in front of her two young children'They have a problem with my country': Africa's best referee, who was denied entry to the US and will miss the World Cup, speaks out and insists he had a valid visa Furious dad films his partner in bed with his 19-year-old son: You've seen the viral video - now all three tell the Daily Mail what REALLY happened in the scandal gripping Australia It's official - Britain is crazy for salmon! New figures released by Salmon Scotland have revealed how demand for the humble fish has soared over the last year.
Eight Predictions for the Future of Higher Education
The next decade won't be Armageddon. But it will bring a lot of change. When I started this six-week-long series by asking whether my daughter would be attending college in 2035, the year she turns eighteen, I was pretty sure I already knew the answer. Nine years is a short amount of time, and something disastrous--or, I suppose, downright liberatory--would need to happen in the culture to make it unlikely for her to shuttle off to some campus after high school. Still, thinking about the future of higher education has convinced me that her path to a bachelor's degree will be very different from the one I began in 1998.