Goto

Collaborating Authors

 Africa


EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models

arXiv.org Artificial Intelligence

In this work, we introduce EMMA-500, a large-scale multilingual language model continue-trained on texts across 546 languages designed for enhanced multilingual performance, focusing on improving language coverage for low-resource languages. To facilitate continual pre-training, we compile the MaLA corpus, a comprehensive multilingual dataset enriched with curated datasets across diverse domains. Leveraging this corpus, we conduct extensive continual pre-training of the Llama 2 7B model, resulting in EMMA-500, which demonstrates robust performance across a wide collection of benchmarks, including a comprehensive set of multilingual tasks and PolyWrite, an open-ended generation benchmark developed in this study. Our results highlight the effectiveness of continual pre-training in expanding large language models' language capacity, particularly for underrepresented languages, demonstrating significant gains in cross-lingual transfer, task generalization, and language adaptability.


Preserving logical and functional dependencies in synthetic tabular data

arXiv.org Artificial Intelligence

Dependencies among attributes are a common aspect of tabular data. However, whether existing tabular data generation algorithms preserve these dependencies while generating synthetic data is yet to be explored. In addition to the existing notion of functional dependencies, we introduce the notion of logical dependencies among the attributes in this article. Moreover, we provide a measure to quantify logical dependencies among attributes in tabular data. Utilizing this measure, we compare several state-of-the-art synthetic data generation algorithms and test their capability to preserve logical and functional dependencies on several publicly available datasets. We demonstrate that currently available synthetic tabular data generation algorithms do not fully preserve functional dependencies when they generate synthetic datasets. In addition, we also showed that some tabular synthetic data generation models can preserve inter-attribute logical dependencies. Our review and comparison of the state-of-the-art reveal research needs and opportunities to develop task-specific synthetic tabular data generation models. Keywords: Synthetic tabular data, Logical dependencies, Functional dependencies, Generative models 1. Introduction Dependencies among attributes are a common aspect of tabular data. A well-known fact in Database Management Systems is that if one wants to remove redundancies by dividing larger tables into smaller ones (Normalization) [1], one needs tools to identify functional dependencies present among the attributes of the larger table [2]. Preserving functional dependencies in synthetic tabular data is an area that has not been explored. Dependencies exist in both tabular and image data.


Zero- and Few-shot Named Entity Recognition and Text Expansion in Medication Prescriptions using ChatGPT

arXiv.org Artificial Intelligence

Introduction: Medication prescriptions are often in free text and include a mix of two languages, local brand names, and a wide range of idiosyncratic formats and abbreviations. Large language models (LLMs) have shown promising ability to generate text in response to input prompts. We use ChatGPT 3.5 to automatically structure and expand medication statements in discharge summaries and thus make them easier to interpret for people and machines. Methods: Named-entity Recognition (NER) and Text Expansion (EX) are used in a zero- and few-shot setting with different prompt strategies. 100 medication statements were manually annotated and curated. NER performance was measured by using strict and partial matching. For the task EX, two experts interpreted the results by assessing semantic equivalence between original and expanded statements. The model performance was measured by precision, recall, and F1 score. Results: For NER, the best-performing prompt reached an average F1 score of 0.94 in the test set. For EX, the few-shot prompt showed superior performance among other prompts, with an average F1 score of 0.87. Conclusion: Our study demonstrates good performance for NER and EX tasks in free-text medication statements using ChatGPT. Compared to a zero-shot baseline, a few-shot approach prevented the system from hallucinating, which would be unacceptable when processing safety-relevant medication data.


Derandomizing Multi-Distribution Learning

arXiv.org Artificial Intelligence

Multi-distribution or collaborative learning involves learning a single predictor that works well across multiple data distributions, using samples from each during training. Recent research on multi-distribution learning, focusing on binary loss and finite VC dimension classes, has shown near-optimal sample complexity that is achieved with oracle efficient algorithms. That is, these algorithms are computationally efficient given an efficient ERM for the class. Unlike in classical PAC learning, where the optimal sample complexity is achieved with deterministic predictors, current multi-distribution learning algorithms output randomized predictors. This raises the question: can these algorithms be derandomized to produce a deterministic predictor for multiple distributions? Through a reduction to discrepancy minimization, we show that derandomizing multi-distribution learning is computationally hard, even when ERM is computationally efficient. On the positive side, we identify a structural condition enabling an efficient black-box reduction, converting existing randomized multi-distribution predictors into deterministic ones.


AI-driven View Guidance System in Intra-cardiac Echocardiography Imaging

arXiv.org Artificial Intelligence

Abstract-- Intra-cardiac Echocardiography (ICE) is a crucial imaging modality used in electrophysiology (EP) and structural heart disease (SHD) interventions, providing realtime, high-resolution views from within the heart. Despite its advantages, effective manipulation of the ICE catheter requires significant expertise, which can lead to inconsistent outcomes, particularly among less experienced operators. To address this challenge, we propose an AIdriven closed-loop view guidance system with human-inthe-loop feedback, designed to assist users in navigating ICE imaging without requiring specialized knowledge. Our method models the relative position and orientation vectors between arbitrary views and clinically defined ICE views in a spatial coordinate system, guiding users on how to manipulate the ICE catheter to transition from the current view to the desired view over time. Overview of the proposed view guidance system. The primary use cases of the ICE imaging involve visualizing target anatomy, detecting and tracking therapeutic devices, and validating treatments in real-time. HE Intra-cardiac Echocardiography (ICE) is a sophisticated imaging modality that offers real-time, highresolution have significant expertise in interpreting anatomical views views from within the heart, making it an invaluable via ICE images and skillfully maneuvering the ICE catheter tool in both electrophysiology (EP) and structural heart disease using two knobs (anterior-posterior, right-left) and the rotating/translating (SHD) interventions.


Zelenskyy questions China's 'true interest' behind plan to end Russia's war

FOX News

Zelenskyy rejected the China-Brazil six-point plan to end Russia's war and questioned'true' intent. Ukrainian President Volodymyr Zelenskyy took to the podium at the 79th United Nations General Assembly (UNGA) for the third time since Russia's deadly invasion began more than two and half years ago, though this time he took direct aim at nations aiding Moscow: China, North Korea and Iran. Zelenskyy – who has long toed the line when it comes to maintaining murky geopolitical relations amid the war – for the first time called out not only the nations supplying direct arms to Moscow, but those who have remained complacent in their refusal to back Ukraine's demands that Russian President Vladimir Putin withdraw his troops. "We need to make it clear the war is over. This is the peace formula – what part of this could be unacceptable to anyone who upholds the U.N. Charter?" he questioned.


How Digital Technology Can Help the U.N. Achieve Its 2030 Agenda

TIME - Tech

As world leaders gather in New York City for the United Nations General Assembly, there's a lot to get done, with just six years left to achieve the bold ambitions laid out for the world's 2030 agenda. When world governments agreed to the 2030 plan back in 2015, a decade and a half seemed like plenty of time to achieve the 17 Sustainable Development Goals (SDGs) designed to create a more prosperous, safe and fair global society. While amazing progress has been made, we are in danger of falling short. I believe the U.N.'s goals can be attained through a collaborative commitment to make digital networks available to everybody in the world. Mobility, broadband and the cloud are the infrastructure of 21st century life and everybody should have that opportunity.


A PT-suitable reference family if: 1. (Full support): supp(π). 2. (Regularity): The log-likelihood ratio between π

Neural Information Processing Systems

B.1 Conditional convergence in distribution Suppose (X, d The proof of this Lemma is identical to the portmanteau lemma for weak convergence by replacing probabilities/expectations with conditional probabilities/expectations (for example, see [38, Section 2.1]). Lemma B.2. Suppose X, X X as m, and X is a constant a.s., then X A, where A is a constant. We can exchange the expectation and limit by the dominated convergence theorem. The result follows by taking ϵ 0. 4. Since X is a.s. For any K > 0, we have x x K is a bounded and continuous function. R. Because f g: X is a bounded and A. We now show that (X The result follows by an application of the continuous mapping theorem with the function (x, A) Ax. B.2 Model assumptions The following sets of assumptions are only used to prove the large-data limit results of Proposition 3.1, Proposition 3.2, and Proposition 3.3. We will always use a subscript m to indicate that the quantity is dependent on the data. For the remainder of this section we will assume the following regularity conditions.


Detecting Temporal Ambiguity in Questions

arXiv.org Artificial Intelligence

Detecting and answering ambiguous questions has been a challenging task in open-domain question answering. Ambiguous questions have different answers depending on their interpretation and can take diverse forms. Temporally ambiguous questions are one of the most common types of such questions. In this paper, we introduce TEMPAMBIQA, a manually annotated temporally ambiguous QA dataset consisting of 8,162 open-domain questions derived from existing datasets. Our annotations focus on capturing temporal ambiguity to study the task of detecting temporally ambiguous questions. We propose a novel approach by using diverse search strategies based on disambiguated versions of the questions. We also introduce and test non-search, competitive baselines for detecting temporal ambiguity using zero-shot and few-shot approaches.


Topological Foundations of Reinforcement Learning

arXiv.org Artificial Intelligence

The goal of this work is to serve as a foundation for deep studies of the topology of state, action, and policy spaces in reinforcement learning. By studying these spaces from a mathematical perspective, we expect to gain more insight into how to build better algorithms to solve decision problems. Therefore, we focus on presenting the connection between the Banach fixed point theorem and the convergence of reinforcement learning algorithms, and we illustrate how the insights gained from this can practically help in designing more efficient algorithms. Before doing so, however, we first introduce relevant concepts such as metric spaces, normed spaces and Banach spaces for better understanding, before expressing the entire reinforcement learning problem in terms of Markov decision processes. This allows us to properly introduce the Banach contraction principle in a language suitable for reinforcement learning, and to write the Bellman equations in terms of operators on Banach spaces to show why reinforcement learning algorithms converge. Finally, we show how the insights gained from the mathematical study of convergence are helpful in reasoning about the best ways to make reinforcement learning algorithms more efficient.