Goto

Collaborating Authors

 Africa


Incorporating Crowdsourced Annotator Distributions into Ensemble Modeling to Improve Classification Trustworthiness for Ancient Greek Papyri

arXiv.org Artificial Intelligence

Performing classification on noisy, crowdsourced image datasets can prove challenging even for the best neural networks. Two issues which complicate the problem on such datasets are class imbalance and ground-truth uncertainty in labeling. The AL-ALL and AL-PUB datasets - consisting of tightly cropped, individual characters from images of ancient Greek papyri - are strongly affected by both issues. The application of ensemble modeling to such datasets can help identify images where the ground-truth is questionable and quantify the trustworthiness of those samples. As such, we apply stacked generalization consisting of nearly identical ResNets with different loss functions: one utilizing sparse cross-entropy (CXE) and the other Kullback-Liebler Divergence (KLD). Both networks use labels drawn from a crowd-sourced consensus. This consensus is derived from a Normalized Distribution of Annotations (NDA) based on all annotations for a given character in the dataset. For the second network, the KLD is calculated with respect to the NDA. For our ensemble model, we apply a k-nearest neighbors model to the outputs of the CXE and KLD networks. Individually, the ResNet models have approximately 93% accuracy, while the ensemble model achieves an accuracy of > 95%, increasing the classification trustworthiness. We also perform an analysis of the Shannon entropy of the various models' output distributions to measure classification uncertainty. Our results suggest that entropy is useful for predicting model misclassifications.


Biden administration warned Iran before ISIS attack Jan. 3, US official says

FOX News

Sen. McConnell supports President Biden's authority for Iran airstrikes, urging stronger action against terrorist threats. President Biden's administration warned Iran of an impending terrorist attack prior to a blast that killed 94 people in early January, a U.S. official tells Fox News Digital. The bombing attack took place at a memorial ceremony for Iranian General Qasem Soleimani, who was killed by a U.S. drone strike on Jan. 3, 2020 under former President Trump's administration. The U.S. official did not detail Iran's response to the warning. "Prior to ISIS' terrorist attack on January 3, 2024, in Kerman, Iran, the U.S. Government provided Iran with a private warning that there was a terrorist threat within Iranian borders," the official told Fox. "The U.S. Government followed a longstanding'duty to warn' policy that has been implemented across administrations to warn governments against potential lethal threats. We provide these warnings in part because we do not want to see innocent lives lost in terror attacks," the official added.


New York watchdog accuses Burkina Faso of war crimes through drone strikes, citing civilian casualties

FOX News

Human Rights Watch said Thursday that Burkina Faso's security forces last year killed at least 60 civilians in three different drone strikes, which the group says may have constituted war crimes. The West African nation's government claimed the strikes targeted extremists, including jihadi fighters and rebel groups that have been operating in many remote communities. The accusation by the New York-based watchdog were the latest in a string of similar charges raised by various rights groups. "The government should urgently and impartially investigate these apparent war crimes, hold those responsible to account, and provide adequate support for the victims and their families," HRW said in a new report. A mural is seen in Ouagadougou, Burkina Faso, on March 1, 2023.


Burkina Faso army strikes killed dozens of civilians, says HRW

Al Jazeera

International watchdog Human Rights Watch (HRW) on Thursday accused the Burkina Faso army of killing at least 60 civilians in drone strikes which the government said targeted armed groups. The deaths occurred in three military drone strikes since August, two at crowded markets and another at a funeral, the rights group said in a new report. Since becoming head of state after a 2022 coup, Captain Ibrahim Traore has focused on a strong security response in reclaiming swathes of territory controlled by armed groups affiliated with al-Qaeda and the ISIS (ISIL) group. But those efforts have often been criticised as heavy-handed, with the HRW report being the latest instance of that criticism. HRW said it interviewed dozens of witnesses between September and November 2023 and analysed photographs, videos and satellite images.


Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators

arXiv.org Artificial Intelligence

The rapid and wide-scale adoption of AI to generate human speech poses a range of significant ethical and safety risks to society that need to be addressed. For example, a growing number of speech generation incidents are associated with swatting attacks in the United States, where anonymous perpetrators create synthetic voices that call police officers to close down schools and hospitals, or to violently gain access to innocent citizens' homes. Incidents like this demonstrate that multimodal generative AI risks and harms do not exist in isolation, but arise from the interactions of multiple stakeholders and technical AI systems. In this paper we analyse speech generation incidents to study how patterns of specific harms arise. We find that specific harms can be categorised according to the exposure of affected individuals, that is to say whether they are a subject of, interact with, suffer due to, or are excluded from speech generation systems. Similarly, specific harms are also a consequence of the motives of the creators and deployers of the systems. Based on these insights we propose a conceptual framework for modelling pathways to ethical and safety harms of AI, which we use to develop a taxonomy of harms of speech generators. Our relational approach captures the complexity of risks and harms in sociotechnical AI systems, and yields an extensible taxonomy that can support appropriate policy interventions and decision making for responsible multimodal model development and release of speech generators.


Efficient Constraint Generation for Stochastic Shortest Path Problems

arXiv.org Artificial Intelligence

Current methods for solving Stochastic Shortest Path Problems (SSPs) find states' costs-to-go by applying Bellman backups, where state-of-the-art methods employ heuristics to select states to back up and prune. A fundamental limitation of these algorithms is their need to compute the cost-to-go for every applicable action during each state backup, leading to unnecessary computation for actions identified as sub-optimal. We present new connections between planning and operations research and, using this framework, we address this issue of unnecessary computation by introducing an efficient version of constraint generation for SSPs. This technique allows algorithms to ignore sub-optimal actions and avoid computing their costs-to-go. We also apply our novel technique to iLAO* resulting in a new algorithm, CG-iLAO*. Our experiments show that CG-iLAO* ignores up to 57% of iLAO*'s actions and it solves problems up to 8x and 3x faster than LRTDP and iLAO*.


Query of CC: Unearthing Large Scale Domain-Specific Knowledge from Public Corpora

arXiv.org Artificial Intelligence

Large language models have demonstrated remarkable potential in various tasks, however, there remains a significant scarcity of open-source models and data for specific domains. Previous works have primarily focused on manually specifying resources and collecting high-quality data on specific domains, which significantly consume time and effort. To address this limitation, we propose an efficient data collection method~\textit{Query of CC} based on large language models. This method bootstraps seed information through a large language model and retrieves related data from public corpora. It not only collects knowledge-related data for specific domains but unearths the data with potential reasoning procedures. Through the application of this method, we have curated a high-quality dataset called~\textsc{Knowledge Pile}, encompassing four major domains, including stem and humanities sciences, among others. Experimental results demonstrate that~\textsc{Knowledge Pile} significantly improves the performance of large language models in mathematical and knowledge-related reasoning ability tests. To facilitate academic sharing, we open-source our dataset and code, providing valuable support to the academic community.


Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis

arXiv.org Artificial Intelligence

In this study, we present a generalizable workflow to identify documents in a historic language with a nonstandard language and script combination, Armeno-Turkish. We introduce the task of detecting distinct patterns of multilinguality based on the frequency of structured language alternations within a document.


Language Modelling Approaches to Adaptive Machine Translation

arXiv.org Artificial Intelligence

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved significant progress in the area of domain adaptation. However, in-domain data scarcity is common in translation settings, due to the lack of specialised datasets and terminology, or inconsistency and inaccuracy of available in-domain translations. In such scenarios where there is insufficient in-domain data to fine-tune MT models, producing translations that are consistent with the relevant context is challenging. While real-time adaptation can make use of smaller amounts of in-domain data to improve the translation on the fly, it remains challenging due to supported context limitations and efficiency constraints. Large language models (LLMs) have recently shown interesting capabilities of in-context learning, where they learn to replicate certain input-output text generation patterns, without further fine-tuning. Such capabilities have opened new horizons for domain-specific data augmentation and real-time adaptive MT. This work attempts to address two main relevant questions: 1) in scenarios involving human interaction and continuous feedback, can we employ language models to improve the quality of adaptive MT at inference time? and 2) in the absence of sufficient in-domain data, can we use pre-trained large-scale language models to improve the process of MT domain adaptation?


Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasets

arXiv.org Artificial Intelligence

The remarkable progress of deep learning in dermatological tasks has brought us closer to achieving diagnostic accuracies comparable to those of human experts. However, while large datasets play a crucial role in the development of reliable deep neural network models, the quality of data therein and their correct usage are of paramount importance. Several factors can impact data quality, such as the presence of duplicates, data leakage across train-test partitions, mislabeled images, and the absence of a well-defined test partition. In this paper, we conduct meticulous analyses of two popular dermatological image datasets: DermaMNIST and Fitzpatrick17k, uncovering these data quality issues, measure the effects of these problems on the benchmark results, and propose corrections to the datasets. Besides ensuring the reproducibility of our analysis, by making our analysis pipeline and the accompanying code publicly available, we aim to encourage similar explorations and to facilitate the identification and addressing of potential data quality issues in other large datasets.