Goto

Collaborating Authors

 Africa


Three West African juntas have turned to Russia. Now the US wants to engage them

BBC News

Three West African juntas have turned to Russia. The US has declared a stark policy shift towards three West African countries which are battling Islamist insurgents and whose military governments have broken defence ties with France and turned towards Russia. The state department announced that Nick Checker, head of its Bureau of African Affairs, would visit Mali's capital Bamako to convey the United States' respect for Mali's sovereignty and chart a new course in relations, moving past policy missteps. It adds that the US also looks forward to co-operating with Mali's allies, neighbouring Burkina Faso and Niger, on shared security and economic interests. Absent from the agenda is the longstanding American concern for democracy and human rights.


GRANITE: A Generalized Regional Framework for Identifying Agreement in Feature-Based Explanations

arXiv.org Machine Learning

Feature-based explanation methods aim to quantify how features influence the model's behavior, either locally or globally, but different methods often disagree, producing conflicting explanations. This disagreement arises primarily from two sources: how feature interactions are handled and how feature dependencies are incorporated. We propose GRANITE, a generalized regional explanation framework that partitions the feature space into regions where interaction and distribution influences are minimized. This approach aligns different explanation methods, yielding more consistent and interpretable explanations. GRANITE unifies existing regional approaches, extends them to feature groups, and introduces a recursive partitioning algorithm to estimate such regions. We demonstrate its effectiveness on real-world datasets, providing a practical tool for consistent and interpretable feature explanations.


A Random Matrix Theory of Masked Self-Supervised Regression

arXiv.org Machine Learning

Self-supervised learning (SSL) -- a training paradigm in which models learn useful representations from unlabeled data by exploiting the data itself as a source of supervision -- has emerged as a foundational component of the recent success of transformer architectures. By avoiding the need for manual annotations, SSL retains many of the benefits traditionally associated with supervised learning while avoiding reliance on labeled data. Consequently, SSL is widely adopted as a pretraining paradigm for learning general-purpose representations that substantially accelerate the optimization of downstream tasks, especially in data-scarce settings. A canonical example of a self-supervised learning task is masked language modeling (MLM), in which a neural network is trained to predict masked tokens in text using the remaining tokens as contextual information (Devlin et al., 2019a; Howard and Ruder, 2018; Radford et al., 2018; Brown et al., 2020; OpenAI, 2024). For example, given the sentence "The capital of France is Paris", a typical MLM task would be to teach the model to infer that we are speaking about the capital of a country from the context "France" and "Paris" from the masked sentence "The [MASK] of France is Paris".


Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval

arXiv.org Machine Learning

Spectral gradient methods, such as the Muon optimizer, modify gradient updates by preserving directional information while discarding scale, and have shown strong empirical performance in deep learning. We investigate the mechanisms underlying these gains through a dynamical analysis of a nonlinear phase retrieval model with anisotropic Gaussian inputs, equivalent to training a two-layer neural network with the quadratic activation and fixed second-layer weights. Focusing on a spiked covariance setting where the dominant variance direction is orthogonal to the signal, we show that gradient descent (GD) suffers from a variance-induced misalignment: during the early escaping stage, the high-variance but uninformative spike direction is multiplicatively amplified, degrading alignment with the true signal under strong anisotropy. In contrast, spectral gradient descent (SpecGD) removes this spike amplification effect, leading to stable alignment and accelerated noise contraction. Numerical experiments confirm the theory and show that these phenomena persist under broader anisotropic covariances.


Drone strikes in Ethiopia's Tigray kill one amid fears of renewed conflict

Al Jazeera

Drone strikes in Ethiopia's Tigray kill one amid fears of renewed conflict One person has been killed and another injured in drone strikes in Ethiopia's northern Tigray region, a senior Tigrayan official and a humanitarian worker said, in another sign of renewed conflict between regional and federal forces. The Tigrayan official on Saturday said the drone strikes hit two Isuzu trucks near Enticho and Gendebta, two places in Tigray about 20km (12 miles) apart. A local humanitarian worker confirmed the strikes had happened. Both asked not to be named, the Reuters news agency reported. It was not immediately clear what the trucks were carrying.


Secret warehouse guards lost world of treasures found on HS2 route

BBC News

Treasures unearthed by hundreds of archaeologists so far during work on the controversial planned HS2 train line have been shown exclusively to the BBC. The 450,000 objects, which are being held in a secret warehouse, include a possible Roman gladiator's tag, a hand axe that may be more than 40,000 years old and 19th Century gold dentures. It is an unprecedented amount and array of items, which will yield new insights into Britain's past, says the Centre for British Archaeology. Major building developments in the UK need land to be assessed by archaeologists as part of the planning process, to protect heritage sites. Since 2018 around 1,000 archaeologists have been involved in 60 digs along the route HS2 is set to take between London to Birmingham.


Apple reports best-ever iPhone sales as Mac dips

BBC News

Sales of the iPhone hit an all-time high in the final three months of last year, tech firm Apple reported on Thursday. Revenue rose by 16% compared to the same period last year to $144bn (£82.5bn) - the strongest growth since 2021 - thanks to a jump in sales in China, as well as Europe, the Americas, and Japan. However, sales in other parts of the company were less positive. Wearables and accessories, which include things like the Apple Watch and AirPods, fell by roughly 3%. Apple chief executive Tim Cook said the iPhone's boost in sales meant the firm was in supply chase mode.


Factorizable joint shift revisited

arXiv.org Machine Learning

Such failure can be caused by distribution shift (also known as dataset shift) between the training and test datasets. For this reason, distribution shift and domain adaptation (a notion comprising techniques for tackling distribution shift) has been a major research topic in machine learning for some time. This paper takes the perspective of Kouw and Loog (2021) and studies the case where feature observations from the test dataset are available for analysis but observations of labels are missing. Under these circumstances, without any assumptions on the nature of the distribution shift between the training and test datasets meaningful prediction of the labels in the test dataset or of their distribution is not feasible. See Kouw and Loog (2021) for a survey of approaches to domain adaptation and their related assumptions. Arguably, covariate shift (also known as population drift) and label shift (also known as prior probability shift or target shift) are the most popular specific distribution shift assumptions, both for their intuiveness as well as their computational manageability. However, exclusive covariate and label shift assumptions have been criticised for being insufficient for common domain adaptation tasks (e.g.


High-dimensional learning dynamics of multi-pass Stochastic Gradient Descent in multi-index models

arXiv.org Machine Learning

We study the learning dynamics of a multi-pass, mini-batch Stochastic Gradient Descent (SGD) procedure for empirical risk minimization in high-dimensional multi-index models with isotropic random data. In an asymptotic regime where the sample size $n$ and data dimension $d$ increase proportionally, for any sub-linear batch size $κ\asymp n^α$ where $α\in [0,1)$, and for a commensurate ``critical'' scaling of the learning rate, we provide an asymptotically exact characterization of the coordinate-wise dynamics of SGD. This characterization takes the form of a system of dynamical mean-field equations, driven by a scalar Poisson jump process that represents the asymptotic limit of SGD sampling noise. We develop an analogous characterization of the Stochastic Modified Equation (SME) which provides a Gaussian diffusion approximation to SGD. Our analyses imply that the limiting dynamics for SGD are the same for any batch size scaling $α\in [0,1)$, and that under a commensurate scaling of the learning rate, dynamics of SGD, SME, and gradient flow are mutually distinct, with those of SGD and SME coinciding in the special case of a linear model. We recover a known dynamical mean-field characterization of gradient flow in a limit of small learning rate, and of one-pass/online SGD in a limit of increasing sample size $n/d \to \infty$.


Thompson sampling: Precise arm-pull dynamics and adaptive inference

arXiv.org Machine Learning

Adaptive sampling schemes are well known to create complex dependence that may invalidate conventional inference methods. A recent line of work shows that this need not be the case for UCB-type algorithms in multi-armed bandits. A central emerging theme is a `stability' property with asymptotically deterministic arm-pull counts in these algorithms, making inference as easy as in the i.i.d. setting. In this paper, we study the precise arm-pull dynamics in another canonical class of Thompson-sampling type algorithms. We show that the phenomenology is qualitatively different: the arm-pull count is asymptotically deterministic if and only if the arm is suboptimal or is the unique optimal arm; otherwise it converges in distribution to the unique invariant law of an SDE. This dichotomy uncovers a unifying principle behind many existing (in)stability results: an arm is stable if and only if its interaction with statistical noise is asymptotically negligible. As an application, we show that normalized arm means obey the same dichotomy, with Gaussian limits for stable arms and a semi-universal, non-Gaussian limit for unstable arms. This not only enables the construction of confidence intervals for the unknown mean rewards despite non-normality, but also reveals the potential of developing tractable inference procedures beyond the stable regime. The proofs rely on two new approaches. For suboptimal arms, we develop an `inverse process' approach that characterizes the inverse of the arm-pull count process via a Stieltjes integral. For optimal arms, we adopt a reparametrization of the arm-pull and noise processes that reduces the singularity in the natural SDE to proving the uniqueness of the invariant law of another SDE. We prove the latter by a set of analytic tools, including the parabolic Hörmander condition and the Stroock-Varadhan support theorem.