Goto

Collaborating Authors

 constraint


US pushes looser approach to AI regulation, while EU pushes new law

Al Jazeera

The European Union and the United States continue to pull in opposite directions on artificial intelligence, with Washington urging other governments to loosen constraints at a recent Group of 20 ministerial meeting. On Tuesday, the US hosted a G20 "innovation" meeting in Chapel Hill, North Carolina, where it put forward arguments against AI-specific regulations. "Policymakers do not need to approach each innovation in isolation and should not treat every emerging technology as a first-of-its-kind policy problem," Kratsios said. Such appeals are part of Trump's overall approach to making the US "the world leader in artificial intelligence". He has led a campaign to slash regulations, including in AI development.


Combining cultures, from code to canvas: an interview with Ken Goldberg

AIHub

Bringing back in the specialists and generalists idea - could you have several specialists on each node, and then a generalist agent overseeing all the nodes? Yes, you can think of it that way. We use the term "orchestrator" - an orchestrator is trying to manage everything, but the complexity gets balanced with a hierarchical structure. You tested this policy on some leading LLMs, and they performed differently to each other. Why do you think Gemini did better than, say, Claude or ChatGPT?


Burnham economic adviser O'Neill rules out government job

BBC News

The economist Lord Jim O'Neill, who has been advising the prime minister, has said he will not be taking a job in Andy Burnham's government. Lord O'Neill, a crossbench peer, was once a treasury minister under the Conservatives. As first reported by, external the Financial Times, he said he did not want the constraints involved in taking on a formal role. The former chief economist at Goldman Sachs had been tipped to become Burnham's chief economic adviser. He said he was enjoying what he was currently doing too much and did not want to have to give up control of his business interests to comply with official rules.


On Rashomon sets, the mathematics of simplicity, and why we don't need black boxes: an interview with Cynthia Rudin

AIHub

On Rashomon sets, the mathematics of simplicity, and why we don't need black boxes: an interview with Cynthia Rudin Welcome back to AI Pioneers - in-depth conversations with those shaping the field . This time, we speak with Cynthia Rudin, a trailblazer in the field of interpretable machine learning. Winner of the 2022 Squirrel AI Award for Artificial Intelligence for the Benefit of Humanity, Cynthia's algorithms are already predicting seizures, aiding crime detection, and powering biological research . We discuss black boxes, Rashomon sets, and what's next for her lab - from cancer detection to interpretable AI-generated music. Can you tell me a bit about your background - what drew you into the field of interpretable machine learning?


Scaling AI agents with trustworthy data

MIT Technology Review

How companies are freeing themselves of legacy data systems to power AI agents that deliver trusted, autonomous action. Business and technology leaders need no convincing that the time of agentic AI is here. Organizations are rapidly adopting agents, and few executives doubt the technology's potential to transform work. But many organizations find that realizing the desired return on investment (ROI) from AI hinges on having the right foundation, with inadequate infrastructure and data being major blockers . The shift from answering questions to taking actions means AI agents need data from across the enterprise, in all its structured and unstructured forms, and with the right business context. To make decisions and act in real time, agents also need frictionless access to the organization's operational systems--for example, those storing its supply chain, point-of-sale, or human resources data.


Active-GRPO: Adaptive Imitation and Self-Improving Reasoning for Molecular Optimization

arXiv.org Machine Learning

Scientific reasoning is an increasingly important capability of large language models, yet improving the robustness and efficiency of training such reasoning remains a key open challenge. We study this problem in instruction-based molecular optimization, where answer-only supervised fine-tuning (SFT) collapses multi-step reasoning and reinforcement learning with verifiable rewards (RLVR) suffers from sparse feedback. Reference-guided Policy Optimization (RePO) mitigates both by anchoring policy updates to dataset-provided references, but its effectiveness is tightly coupled to reference quality: weak or misaligned references impose a performance ceiling. To overcome this ceiling, we propose active reasoning, a paradigm in which the policy actively decides, on a per-instance basis, when to imitate a reference and when to reinforce its own discoveries, while continuously upgrading what it imitates. We instantiate this paradigm as Active Group Relative Policy Optimization (Active-GRPO), realized through two coupled mechanisms: active imitate-reinforce and active referencing. The former performs imitation learning when the reference still outperforms the policy's own candidates, and shifts to self-improvement via reinforcement learning once the policy has generated molecules that surpass the reference. The latter continuously upgrades the reference itself by replacing it with the best policy-generated candidate discovered so far, progressively raising the imitation target and ensuring that reference guidance remains informative--rather than restrictive--throughout training. Across TOMG-Bench MOLOPT, Active-GRPO improves average SR Sim from 0.0959 for GRPO and 0.1665 for RePO to 0.1773 under matched three-seed evaluation, with statistically significant gains on LogP, MR, and QED.


spca: An R package to Compute Least Squares Sparse Principal Components

arXiv.org Machine Learning

This paper introduces the R package spca, which provides a computational framework for least squares sparse principal component analysis (LS-SPCA). Unlike other SPCA methods, LS-SPCA generates uncorrelated sparse principal components (sPCs) that effectively maximize the explained variance while maintaining strong correlations with standard principal components (PCs). The framework also includes more computationally efficient variants that produce mildly correlated sPCs, which often have lower cardinality while explaining equal or greater variance than the LS-SPCA optimal sPCs. The spca package is built on an efficient C++ backend for matrix computations, with distinct engines for tall and fat matrices, and a flexible R frontend. The user interface offers several options for computing sPCs, such as deciding whether sparsification should stop when a threshold for cumulative variance explained or R2 with the PCs is reached, and choosing between simple forward selection, stepwise forward selection, or backward elimination for variable selection. In addition to the print(), summary(), and plot() methods, the package includes tools for comparing different "spca" solutions, grouping sparse loadings, and representing foreign SPCA solutions as "spca" objects. This article demonstrates with real datasets the use of the package in a typical LS-SPCA workflow and briefly contrasts LS-SPCA with conventional SPCA solutions . Then it compares different LS-SPCA solutions obtained from the dataset. Finally, the performance of spca on large tall and fat matrices is discussed, showing that spca offers a computationally efficient alternative for computing interpretable sPCs.


Conformal Prediction with Macro-Coverage Guarantees

arXiv.org Machine Learning

Prediction sets should have high coverage to be useful, but some coverage notions are more practically relevant than others. In the classification setting, class-conditional coverage requires that the prediction set (i.e., the set of candidate labels for a new test point) must achieve the target accuracy level within each class, which may be challenging to satisfy when many classes are rare and have few calibration points. At the other extreme, marginal coverage requires only that coverage holds on average over the distribution of all classes, which can lead to low-probability labels being essentially ignored. To find a middle ground, recent work has introduced macro-coverage, defined as the unweighted average of class-conditional coverages. Macro-coverage offers a compromise between marginal coverage and class-conditional coverage that is particularly appropriate for long-tailed settings. In this work, we show that label-weighted conformal prediction can be used to produce prediction sets with a finite-sample macro-coverage guarantee, and more generally a guarantee on a family of generalized macro-coverage objectives that aggregate coverage at the level of arbitrary class groupings and take a weighted average. We further characterize the form of the smallest prediction sets satisfying a given generalized macro-coverage objective and propose a corresponding conformal score function. We validate our theoretical results on two large-scale image classification datasets.


Not All Objectives Are Born Equal: Priority-Constrained Descent for Hierarchical Multi-Objective Optimization

arXiv.org Machine Learning

Deep learning problems rarely involve objectives that are equal in importance. A primary objective defines the goal, whilst secondary objectives, such as sparsity, compression, or robustness constrain the solution. While existing multi-objective methods have proven effective in practice, they have a clear symmetry problem and neglect the inherent objective hierarchy built into these objective spaces. We introduce Priority-Constrained Descent (PCD), a gradient-based optimization framework designed to explicitly exploit hierarchical objective structures. PCD preserves the direction of primary descent whilst allowing for the minimal distortion necessary to guarantee progress on secondary objectives, controlled by a single $τ\in [0, 1]$ that dictates the strength of the distortion. The resulting formulation is invariant to objective scaling and admits exact closed-form solutions for problems with two and three objectives. We evaluate PCD within structured network compression settings, unstructured sparsity and low-rankness, and across a variety of synthetic experiments, showing Pareto dominance and better per-objective performance with secondary progress guarantees over existing methods, further exhibiting the interpretable trade-off that $τ$ provides.


Convergence of Continual Learning in Homogeneous Deep Networks

arXiv.org Machine Learning

We characterize weakly regularized continual classification in homogeneous models as sequential projections onto task margin sets. This result generalizes prior analyses restricted to either stationary (single-task) deep models or continual linear models. We show that global convergence generally fails, even for simple models linear in data but nonlinear in parameters. Nevertheless, by leveraging results from nonconvex projection theory, we identify regularity properties of homogeneous deep networks that guarantee local linear convergence under random and cyclic task sequences. Finally, we extend our analysis to continual regression, unifying the framework for homogeneous models.