Goto

Collaborating Authors

 Africa


Where Are All the AI Drugs?

WIRED

A new drug usually starts with a tragedy. Born in what is now Zimbabwe, the child of a mechanic and a radiology technician, Ray fled with his family to South Africa during the Zimbabwean War of Liberation. He remembers the journey there in 1980 in a convoy of armored cars. As the sun blazed down, a soldier taught 8-year-old Ray how to fire a machine gun. But his mother kept having to stop.


Model averaging in the space of probability distributions

arXiv.org Machine Learning

In the modern era, the complexity and density of data structures have significantly increased, particularly with the advent of technologies such as cloud computing, sensor networks and manifold-based data representations. A notable case within this landscape is the class of measure-valued data, which encompasses data best represented through probability distributions rather than individual observations (Ranjan and Gneiting, 2010; Gneiting and Ranjan, 2013). This framework is prevalent across various fields, including actuarial science, economics and finance, environmental sciences, etc where uncertainty and heterogeneity are inherent and models must reflect the full distributional information. For instance, in economics integrating diverse models allows for the generation of numerous meaningfull probabilistic scenarios that can effectively inform future decision-making (Moral-Benito, 2015; Hong and Martin, 2017; Christensen et al., 2018; Steel, 2020; Koundouri et al., 2024). In environmental sciences, the prediction of future states through stochastic simulation models is crucial for evaluating the consequences of natural hazards (Muis et al., 2015; Hsiang et al., 2017; Fronzek et al., 2022) or improving climatic forecasts (Friederichs and Thorarinsdottir, 2012; Scheuerer and M oller, 2015; Papayiannis et al., 2018).


Towards few-shot isolated word reading assessment

arXiv.org Artificial Intelligence

We explore an ASR-free method for isolated word reading assessment in low-resource settings. Our few-shot approach compares input child speech to a small set of adult-provided reference templates. Inputs and templates are encoded using intermediate layers from large self-supervised learned (SSL) models. Using an Afrikaans child speech benchmark, we investigate design options such as discretising SSL features and barycentre averaging of the templates. Idealised experiments show reasonable performance for adults, but a substantial drop for child speech input, even with child templates. Despite the success of employing SSL representations in low-resource speech tasks, our work highlights the limitations of SSL representations for processing child data when used in a few-shot classification system.


Position Prediction Self-Supervised Learning for Multimodal Satellite Imagery Semantic Segmentation

arXiv.org Artificial Intelligence

Semantic segmentation of satellite imagery is crucial for Earth observation applications, but remains constrained by limited labelled training data. While self-supervised pretraining methods like Masked Autoencoders (MAE) have shown promise, they focus on reconstruction rather than localisation-a fundamental aspect of segmentation tasks. We propose adapting LOCA (Location-aware), a position prediction self-supervised learning method, for multimodal satellite imagery semantic segmentation. Our approach addresses the unique challenges of satellite data by extending SatMAE's channel grouping from multispectral to multimodal data, enabling effective handling of multiple modalities, and introducing same-group attention masking to encourage cross-modal interaction during pretraining. The method uses relative patch position prediction, encouraging spatial reasoning for localisation rather than reconstruction. We evaluate our approach on the Sen1Floods11 flood mapping dataset, where it significantly outperforms existing reconstruction-based self-supervised learning methods for satellite imagery. Our results demonstrate that position prediction tasks, when properly adapted for multimodal satellite imagery, learn representations more effective for satellite image semantic segmentation than reconstruction-based approaches.


Pink Floppy Disc and The Bitles: Embracing the future of AI music

New Scientist

Feedback is New Scientist's popular sideways look at the latest science and technology news. You can submit items you believe may amuse readers to Feedback by emailing feedback@newscientist.com Feedback has been dimly aware for a while that there is a slew of AI-generated music swamping platforms like Spotify. Our awareness was limited, we confess, because we are so old that we still prefer to listen to CDs. Still, we weren't too surprised when New Scientist's Timothy Revell told us about an indie rock band called The Velvet Sundown that appears to be entirely AI-generated, from their songs, which sound like the beige love-children of Coldplay and the Eagles, to their uncanny-valley Instagram photos, which look like rejected concept art from Daisy Jones & the Six.


Interpretable Bayesian Tensor Network Kernel Machines with Automatic Rank and Feature Selection

arXiv.org Machine Learning

Tensor Network (TN) Kernel Machines speed up model learning by representing parameters as low-rank TNs, reducing computation and memory use. However, most TN-based Kernel methods are deterministic and ignore parameter uncertainty. Further, they require manual tuning of model complexity hyperparameters like tensor rank and feature dimensions, often through trial-and-error or computationally costly methods like cross-validation. We propose Bayesian Tensor Network Kernel Machines, a fully probabilistic framework that uses sparsity-inducing hierarchical priors on TN factors to automatically infer model complexity. This enables automatic inference of tensor rank and feature dimensions, while also identifying the most relevant features for prediction, thereby enhancing model interpretability. All the model parameters and hyperparameters are treated as latent variables with corresponding priors. Given the Bayesian approach and latent variable dependencies, we apply a mean-field variational inference to approximate their posteriors. We show that applying a mean-field approximation to TN factors yields a Bayesian ALS algorithm with the same computational complexity as its deterministic counterpart, enabling uncertainty quantification at no extra computational cost. Experiments on synthetic and real-world datasets demonstrate the superior performance of our model in prediction accuracy, uncertainty quantification, interpretability, and scalability.


An Agentic Flow for Finite State Machine Extraction using Prompt Chaining

arXiv.org Artificial Intelligence

--Finite-State Machines (FSMs) are critical for modeling the operational logic of network protocols, enabling verification, analysis, and vulnerability discovery. However, existing FSM extraction techniques face limitations such as scalability, incomplete coverage, and ambiguity in natural language specifications. In this paper, we propose FlowFSM, a novel agen-tic framework that leverages Large Language Models (LLMs) combined with prompt chaining and chain-of-thought reasoning to extract accurate FSMs from raw RFC documents. FlowFSM systematically processes protocol specifications, identifies state transitions, and constructs structured rule-books by chaining agent outputs. Experimental evaluation across FTP and RTSP protocols demonstrates that FlowFSM achieves high extraction precision while minimizing hallucinated transitions, showing promising results. Our findings highlight the potential of agent-based LLM systems in the advancement of protocol analysis and FSM inference for cybersecurity and reverse engineering applications.


Artificial Finance: How AI Thinks About Money

arXiv.org Artificial Intelligence

In this paper, we explore how large language models (LLMs) approach financial decision - making by systematically comparing their responses to those of human participants across the globe. We posed a set of commonly used financial decision - making questions t o seven leading LLMs, including five models from the GPT series (GPT - 4o, GPT - 4.5, o1, o3 - mini), Gemini 2.0 Flash, and DeepSeek R1 . We then compared their outputs to human responses drawn from a dataset covering 53 nations. Our analysis reveals three main r esults. First, LLMs generally exhibit a risk - neutral decision - making pattern, favoring choices aligned with expected value calculations when faced with lottery - type questions . Second, when evaluating trade - offs between present and future, LLMs occasionally produce responses that appear inconsistent with normative reasoning . Third, when we examine cross - national similarities, we f ind that the LLMs' aggregate responses most closely resemble those of participants from Tanzania. These findings contribute to the understanding of how LLMs emulate human - like decision behaviors and highlight potential cultural and training influences embedded within their outputs.


HYPEROFA: Expanding LLM Vocabulary to New Languages via Hypernetwork-Based Embedding Initialization

arXiv.org Artificial Intelligence

Many pre-trained language models (PLMs) exhibit suboptimal performance on mid- and low-resource languages, largely due to limited exposure to these languages during pre-training. A common strategy to address this is to introduce new tokens specific to the target languages, initialize their embeddings, and apply continual pre-training on target-language data. Among such methods, OFA (Liu et al., 2024a) proposes a similarity-based subword embedding initialization heuristic that is both effective and efficient. However, OFA restricts target-language token embeddings to be convex combinations of a fixed number of source-language embeddings, which may limit expressiveness. To overcome this limitation, we propose HYPEROFA, a hypernetwork-based approach for more adaptive token embedding initialization. The hypernetwork is trained to map from an external multilingual word vector space to the PLMs token embedding space using source-language tokens. Once trained, it can generate flexible embeddings for target-language tokens, serving as a good starting point for continual pretraining. Experiments demonstrate that HYPEROFA consistently outperforms random initialization baseline and matches or exceeds the performance of OFA in both continual pre-training convergence and downstream task performance. We make the code publicly available.


Clio-X: AWeb3 Solution for Privacy-Preserving AI Access to Digital Archives

arXiv.org Artificial Intelligence

As archives turn to artificial intelligence to manage growing volumes of digital records, privacy risks inherent in current AI data practices raise critical concerns about data sovereignty and ethical accountability. This paper explores how privacy-enhancing technologies (PETs) and Web3 architectures can support archives to preserve control over sensitive content while still being able to make it available for access by researchers. We present Clio-X, a decentralized, privacy-first Web3 digital solution designed to embed PETs into archival workflows and support AI-enabled reference and access. Drawing on a user evaluation of a medium-fidelity prototype, the study reveals both interest in the potential of the solution and significant barriers to adoption related to trust, system opacity, economic concerns, and governance. Using Rogers' Diffusion of Innovation theory, we analyze the sociotechnical dimensions of these barriers and propose a path forward centered on participatory design and decentralized governance through a Clio-X Decentralized Autonomous Organization. By integrating technical safeguards with community-based oversight, Clio-X offers a novel model to ethically deploy AI in cultural heritage contexts.