Africa
Development of a WAZOBIA-Named Entity Recognition System
Emedem, S. E, Onyenwe, I. E, Onyedinma, E. G
Named Entity Recognition NER is very crucial for various natural language processing applications, including information extraction, machine translation, and sentiment analysis. Despite the ever-increasing interest in African languages within computational linguistics, existing NER systems focus mainly on English, European, and a few other global languages, leaving a significant gap for under-resourced languages. This research presents the development of a WAZOBIA-NER system tailored for the three most prominent Nigerian languages: Hausa, Yoruba, and Igbo. This research begins with a comprehensive compilation of annotated datasets for each language, addressing data scarcity and linguistic diversity challenges. Exploring the state-of-the-art machine learning technique, Conditional Random Fields (CRF) and deep learning models such as Bidirectional Long Short-Term Memory (BiLSTM), Bidirectional Encoder Representation from Transformers (Bert) and fine-tune with a Recurrent Neural Network (RNN), the study evaluates the effectiveness of these approaches in recognizing three entities: persons, organizations, and locations. The system utilizes optical character recognition (OCR) technology to convert textual images into machine-readable text, thereby enabling the Wazobia system to accept both input text and textual images for extraction purposes. The system achieved a performance of 0.9511 in precision, 0.9400 in recall, 0.9564 in F1-score, and 0.9301 in accuracy. The model's evaluation was conducted across three languages, with precision, recall, F1-score, and accuracy as key assessment metrics. The Wazobia-NER system demonstrates that it is feasible to build robust NER tools for under-resourced African languages using current NLP frameworks and transfer learning.
HealthBench: Evaluating Large Language Models Towards Improved Human Health
Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiรฑonero-Candela, Joaquin, Tsimpourlas, Foivos, Sharman, Michael, Shah, Meghan, Vallone, Andrea, Beutel, Alex, Heidecke, Johannes, Singhal, Karan
HealthBench consists of 5,000 multi-turn conversations between a model and an individual user or healthcare professional. Responses are evaluated using conversation-specific rubrics created by 262 physicians. Unlike previous multiple-choice or short-answer benchmarks, Health-Bench enables realistic, open-ended evaluation through 48,562 unique rubric criteria spanning several health contexts (e.g., emergencies, transforming clinical data, global health) and behavioral dimensions (e.g., accuracy, instruction following, communication). HealthBench performance over the last two years reflects steady initial progress (compare GPT-3.5 Turbo's 16% to GPT-4o's 32%) and more rapid recent improvements (o3 scores 60%). Smaller models have especially improved: GPT-4.1 nano outperforms GPT-4o and is 25 times cheaper. We additionally release two HealthBench variations: HealthBench Consensus, which includes 34 particularly important dimensions of model behavior validated via physician consensus, and HealthBench Hard, where the current top score is 32%. We hope that HealthBench grounds progress towards model development and applications that benefit human health.
US tech firms secure AI deals as Trump tours Gulf states
A swath of US technology firms announced deals in the Middle East as Donald Trump trumpeted 600bn in commitments from Saudi Arabia to American artificial intelligence companies during a tour of Gulf states. Among the biggest deals was a set signed by Nvidia. The company will sell hundreds of thousands of AI chips in Saudi Arabia, with a first tranche of 18,000 of its newest "Blackwell" chips going to Humain, Saudi Arabia's sovereign-wealth-fund-owned AI startup, Reuters reported. Cisco on Tuesday said it had signed a deal with G42, the AI firm based in the United Arab Emirates, to help the company develop that country's AI sector. Trump plans to visit the UAE on Thursday.
Kelp noodle stir fry, soybean spaghetti and dandelion salad: Climate scientists reveal what we'll be eating for dinner in the future - so, would you try it?
The likes of shepherd's pie and fish & chips soon be off Britain's dinner menu in favour of more eco-friendly options, according to a new report. Scientists have teamed up with HelloFresh to predict what Brits will be eating in just 10 years time as we fight to halt climate change. And the menu of the near future reveals five very bizarre options โ with no meat in sight. There's a stir fry with noodles made out of kelp (a type of brown algae) as well as'meatballs' made with mushrooms on a bed of sorghum. There's also teff galette โ a French-style tart made out of teff, a highly-nutritious ancient grain โ served with dandelion salad.
Drones, gold, and threats: Sudan's war raises regional tensions
On May 4, Sudan's paramilitary Rapid Support Forces (RSF) launched a barrage of suicide drones at Port Sudan, the army's de facto wartime capital on the Red Sea. The Sudanese Armed Forces (SAF) accused foreign actors of supporting the RSF's attacks and even threatened to sever ties with one of its biggest trading partners. The RSF surprised many with the strikes. It had used drones before, but never hit targets as far away as Port Sudan, which used to be a haven, until last week. "The strikes โฆ led to a huge displacement from the city. Many people left Port Sudan," Aza Aera, a local relief worker, told Al Jazeera.
Trump targets massive investments in first Middle East trip
Former President Donald Trump is embarking this week on a high-stakes tour of the Persian Gulf region, targeting business deals and strategic partnerships with three oil-rich nations: Saudi Arabia, the United Arab Emirates and Qatar. The trip marks Trump's first major foreign visit of his new term and comes as nuclear negotiations with Iran drag on and as war continues between Israel and the Palestinian terror organization, Hamas, in the Gaza Strip. While business is the official focus, the backdrop is anything but calm. White House press secretary Karoline Leavitt described the mission as part of Trump's broader vision that "extremism is defeated [through] commerce and cultural exchanges." Under President Joe Biden, U.S. relations with Gulf states cooled, particularly after Biden vowed to make Saudi Crown Prince Mohammed bin Salman a "pariah" over the 2018 killing of journalist Jamal Khashoggi.
QUPID: Quantified Understanding for Enhanced Performance, Insights, and Decisions in Korean Search Engines
Kwon, Ohjoon, Lee, Changsu, Back, Jihye, Suk, Lim Sun, Kang, Inho, Jeon, Donghyeon
Large language models (LLMs) have been widely used for relevance assessment in information retrieval. However, our study demonstrates that combining two distinct small language models (SLMs) with different architectures can outperform LLMs in this task. Our approach -- QUPID -- integrates a generative SLM with an embedding-based SLM, achieving higher relevance judgment accuracy while reducing computational costs compared to state-of-the-art LLM solutions. This computational efficiency makes QUPID highly scalable for real-world search systems processing millions of queries daily. In experiments across diverse document types, our method demonstrated consistent performance improvements (Cohen's Kappa of 0.646 versus 0.387 for leading LLMs) while offering 60x faster inference times. Furthermore, when integrated into production search pipelines, QUPID improved nDCG@5 scores by 1.9%. These findings underscore how architectural diversity in model combinations can significantly enhance both search relevance and operational efficiency in information retrieval systems.
Divide (Text) and Conquer (Sentiment): Improved Sentiment Classification by Constituent Conflict Resolution
Koลciaลkowski, Jan, Marcinkowski, Paweล
Sentiment classification, a complex task in natural language processing, becomes even more challenging when analyzing passages with multiple conflicting tones. Typically, longer passages exacerbate this issue, leading to decreased model performance. The aim of this paper is to introduce novel methodologies for isolating conflicting sentiments and aggregating them to effectively predict the overall sentiment of such passages. One of the aggregation strategies involves a Multi-Layer Perceptron (MLP) model which outperforms baseline models across various datasets, including Amazon, Twitter, and SST while costing $\sim$1/100 of what fine-tuning the baseline would take.
Exploring Multimodal Foundation AI and Expert-in-the-Loop for Sustainable Management of Wild Salmon Fisheries in Indigenous Rivers
Xu, Chi, Jin, Yili, Ma, Sami, Qian, Rongsheng, Fang, Hao, Liu, Jiangchuan, Liu, Xue, Ngai, Edith C. H., Atlas, William I., Connors, Katrina M., Spoljaric, Mark A.
Wild salmon are essential to the ecological, economic, and cultural sustainability of the North Pacific Rim. Y et climate variability, habitat loss, and data limitations in remote ecosystems that lack basic infrastructure support pose significant challenges to effective fisheries management. This project explores the integration of multimodal foundation AI and expert-in-the-loop frameworks to enhance wild salmon monitoring and sustainable fisheries management in Indigenous rivers across Pacific Northwest. By leveraging video and sonar-based monitoring, we develop AI-powered tools for automated species identification, counting, and length measurement, reducing manual effort, expediting delivery of results, and improving decision-making accuracy. Expert validation and active learning frameworks ensure ecological relevance while reducing annotation burdens. To address unique technical and societal challenges, we bring together a cross-domain, interdisciplinary team of university researchers, fisheries biologists, Indigenous stewardship practitioners, government agencies, and conservation organizations. Through these collaborations, our research fosters ethical AI co-development, open data sharing, and culturally informed fisheries management.
FNBench: Benchmarking Robust Federated Learning against Noisy Labels
Jiang, Xuefeng, Li, Jia, Wu, Nannan, Wu, Zhiyuan, Li, Xujing, Sun, Sheng, Xu, Gang, Wang, Yuwei, Li, Qi, Liu, Min
Robustness to label noise within data is a significant challenge in federated learning (FL). From the data-centric perspective, the data quality of distributed datasets can not be guaranteed since annotations of different clients contain complicated label noise of varying degrees, which causes the performance degradation. There have been some early attempts to tackle noisy labels in FL. However, there exists a lack of benchmark studies on comprehensively evaluating their practical performance under unified settings. To this end, we propose the first benchmark study FNBench to provide an experimental investigation which considers three diverse label noise patterns covering synthetic label noise, imperfect human-annotation errors and systematic errors. Our evaluation incorporates eighteen state-of-the-art methods over five image recognition datasets and one text classification dataset. Meanwhile, we provide observations to understand why noisy labels impair FL, and additionally exploit a representation-aware regularization method to enhance the robustness of existing methods against noisy labels based on our observations. Finally, we discuss the limitations of this work and propose three-fold future directions. To facilitate related communities, our source code is open-sourced at https://github.com/Sprinter1999/FNBench.