Goto

Collaborating Authors

 Africa


Generalized Nonnegative Structured Kruskal Tensor Regression

arXiv.org Machine Learning

Tensor decompositions have emerged as powerful analytical tools across diverse fields including signal/image processing [1, 2, 3, 4, 5, 6], chemometrics [7], geophysics [8, 9], and neuroscience [10, 11, 12, 13]. Their effectiveness stems from their ability to approximate high-dimensional tensors with low-rank decompositions, offering efficient dimensionality reduction while preserving essential structural information. For example, tensor decomposition techniques [14, 15, 16] are applied in hyperspectral image (HSI) analysis to extract low-rank structures for dimensionality reduction [9], and used in electroencephalogram (EEG) analysis to capture latent patterns across multiple dimensions [10]. Over the past decade, tensor regression (TR) models have received attention, with numerous approaches proposed in the literature, including Tucker tensor regression [17], low-rank orthogonally decomposable tensor regression [18], Bayesian Kruskal tensor regression (KTR) [19], Bayesian low rank tensor ring completion [20], graph-regularized tensor regression [21], and tensor regression network [22].


Mamba Modulation: On the Length Generalization of Mamba

arXiv.org Machine Learning

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading architecture, achieving state-of-the-art results across a range of language modeling tasks. However, Mamba's performance significantly deteriorates when applied to contexts longer than those seen during pre-training, revealing a sharp sensitivity to context length extension. Through detailed analysis, we attribute this limitation to the out-of-distribution behaviour of its state-space dynamics, particularly within the parameterization of the state transition matrix $\mathbf{A}$. Unlike recent works which attribute this sensitivity to the vanished accumulation of discretization time steps, $\exp(-\sum_{t=1}^Nฮ”_t)$, we establish a connection between state convergence behavior as the input length approaches infinity and the spectrum of the transition matrix $\mathbf{A}$, offering a well-founded explanation of its role in length extension. Next, to overcome this challenge, we propose an approach that applies spectrum scaling to pre-trained Mamba models to enable robust long-context generalization by selectively modulating the spectrum of $\mathbf{A}$ matrices in each layer. We show that this can significantly improve performance in settings where simply modulating $ฮ”_t$ fails, validating our insights and providing avenues for better length generalization of state-space models with structured transition matrices.


Morphological Synthesizer for Ge'ez Language: Addressing Morphological Complexity and Resource Limitations

arXiv.org Artificial Intelligence

Ge'ez is an ancient Semitic language renowned for its unique alphabet. It serves as the script for numerous languages, including Tigrinya and Amharic, and played a pivotal role in Ethiopia's cultural and religious development during the Aksumite kingdom era. Ge'ez remains significant as a liturgical language in Ethiopia and Eritrea, with much of the national identity documentation recorded in Ge'ez. These written materials are invaluable primary sources for studying Ethiopian and Eritrean philosophy, creativity, knowledge, and civilization. Ge'ez has a complex morphological structure with rich inflectional and derivational morphology, and no usable NLP has been developed and published until now due to the scarcity of annotated linguistic data, corpora, labeled datasets, and lexicons. Therefore, we propose a rule-based Ge'ez morphological synthesizer to generate surface words from root words according to the morphological structures of the language. We used 1,102 sample verbs, representing all verb morphological structures, to test and evaluate the system. The system achieves a performance of 97.4%, outperforming the baseline model and suggesting that future work should build a comprehensive system considering morphological variations of the language. Keywords: Ge'ez, NLP, morphology, morphological synthesizer, rule-based


Design Insights and Comparative Evaluation of a Hardware-Based Cooperative Perception Architecture for Lane Change Prediction

arXiv.org Artificial Intelligence

Traffic accidents remain a major global concern, with lane-change maneuvers recognized as one of the significant contributors to collision risk. Anticipating these maneuvers has become an important research focus, supporting both traffic safety and the safe integration of autonomous and assisted driving technologies. Over the past decade, numerous models have been developed for lane-change prediction. However, most existing works have been designed and validated using simulation environments or pre-recorded datasets. While these settings allow for benchmarking and controlled evaluation, they often rely on simplified assumptions about sensing, communication, and vehicle behavior that do not fully capture the complexity of real-world operation. Real-world deployments of lane-change prediction systems are relatively rare, and when they are reported, their practical challenges, limitations, and insights remain under-documented. To illustrate the setting more concretely, consider the left lane change scenario shown in Figure 1. The Ego Vehicle (EV) is driving in the left lane, while the Target Vehicle (TV) is moving in the right lane behind a Preceding Vehicle (PV). When the PV suddenly brakes, the TV must change lanes to avoid a collision.


Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks

arXiv.org Artificial Intelligence

Dialectal data are characterized by linguistic variation that appears small to humans but has a significant impact on the performance of models. This dialect gap has been related to various factors (e.g., data size, economic and social factors) whose impact, however, turns out to be inconsistent. In this work, we investigate factors impacting the model performance more directly: we correlate Tokenization Parity (TP) and Information Parity (IP), as measures of representational biases in pre-trained multilingual models, with the downstream performance. We compare state-of-the-art decoder-only LLMs with encoder-based models across three tasks: dialect classification, topic classification, and extractive question answering, controlling for varying scripts (Latin vs. non-Latin) and resource availability (high vs. low). Our analysis reveals that TP is a better predictor of the performance on tasks reliant on syntactic and morphological cues (e.g., extractive QA), while IP better predicts performance in semantic tasks (e.g., topic classification). Complementary analyses, including tokenizer behavior, vocabulary coverage, and qualitative insights, reveal that the language support claims of LLMs often might mask deeper mismatches at the script or token level.


A Federated Fine-Tuning Paradigm of Foundation Models in Heterogenous Wireless Networks

arXiv.org Artificial Intelligence

Edge intelligence has emerged as a promising strategy to deliver low-latency and ubiquitous services for mobile devices. Recent advances in fine-tuning mechanisms of foundation models have enabled edge intelligence by integrating low-rank adaptation (LoRA) with federated learning. However, in wireless networks, the device heterogeneity and resource constraints on edge devices pose great threats to the performance of federated fine-tuning. To tackle these issues, we propose to optimize federated fine-tuning in heterogenous wireless networks via online learning. First, the framework of switching-based federated fine-tuning in wireless networks is provided. The edge devices switches to LoRA modules dynamically for federated fine-tuning with base station to jointly mitigate the impact of device heterogeneity and transmission unreliability. Second, a tractable upper bound on the inference risk gap is derived based on theoretical analysis. To improve the generalization capability, we formulate a non-convex mixed-integer programming problem with long-term constraints, and decouple it into model switching, transmit power control, and bandwidth allocation subproblems. An online optimization algorithm is developed to solve the problems with polynomial computational complexity. Finally, the simulation results on the SST-2 and QNLI data sets demonstrate the performance gains in test accuracy and energy efficiency.


Houthi drone strike hits Israeli city of Eilat, injuring 22

Al Jazeera

Is recognising Palestine a way to'save face' for Western leaders? This is the moment a drone launched by Yemen's Houthis exploded in the Israeli city of Eilat. Footage shows it over the southern port city before bursting into flames in a residential neighbourhood, injuring at least 22 people, after Israeli military failed to intercept it. Finland's president hails rise of global south at UNGA Estonia calls Russian jets violating its airspace a'hostile act'


Spain to join Italy in deploying naval ship to escort Gaza flotilla

Al Jazeera

Is recognising Palestine a way to'save face' for Western leaders? A Spanish naval vessel will join the Global Sumud Flotilla for Gaza to provide assistance and, if necessary, conduct rescues, Spanish Prime Minister Pedro Sanchez has said. Italy earlier announced it was dispatching a frigate after a night of drone attacks on the humanitarian flotilla opposed by the Israeli government. Finland's president hails rise of global south at UNGA Estonia calls Russian jets violating its airspace a'hostile act'


Computing in the Arab World: Innovations, Challenges, and Advances amidst a Rich Mosaic of Scientific Activity

Communications of the ACM

Membership in ACM includes a subscription to Communications of the ACM (CACM), the computing industry's most trusted source for staying connected to the world of advanced computing. The Regional Special Section of the Arab World highlights some of the region's exciting, innovative, and socially relevant advances in computing and its applications. It is with great pleasure that we present this Communications of the ACM Regional Special Section of the Arab World. In this second edition, we highlight some of the region's exciting, innovative, and socially relevant advances in computing and its applications. The Arab world is home to a rich mosaic of cultures, histories, and geographies, stretching from the Atlantic Ocean to the Gulf.


Digital Twins: Initiatives, Technologies, and Use Cases in the Arab World

Communications of the ACM

Membership in ACM includes a subscription to Communications of the ACM (CACM), the computing industry's most trusted source for staying connected to the world of advanced computing. Digital twins (DTs) are virtual replicas of components, assets, systems, or processes, linked to their real-world counterparts, continuously updating their states and simulating their behavior in real-time, as illustrated in Figure 1 . They are adopted for monitoring, predicting, and optimizing the performance of diverse systems, bridging the gap between design, testing and deployment. Significant efforts are being devoted across Arab R&D institutions to export technology tackling challenges that are not only pertinent to the region, but also of global importance, e.g., energy, sustainability, disaster management, healthcare, and urbanization, among many others. For instance, Khalifa University, UAE, is pioneering research into optical wireless communication using DTs.