Africa
Language Models Learn Metadata: Political Stance Detection Case Study
Stance detection is a crucial NLP task with numerous applications in social science, from analyzing online discussions to assessing political campaigns. This paper investigates the optimal way to incorporate metadata into a political stance detection task. We demonstrate that previous methods combining metadata with language-based data for political stance detection have not fully utilized the metadata information; our simple baseline, using only party membership information, surpasses the current state-of-the-art. We then show that prepending metadata (e.g., party and policy) to political speeches performs best, outperforming all baselines, indicating that complex metadata inclusion systems may not learn the task optimally.
Black Myth: Wukong – Why the Chinese game is taking the world by storm
A new Chinese video game has created a buzz worldwide after it sold more than 10 million copies within three days, becoming the most successful game of all time to emerge from the country. According to 2023 estimates, China's gaming industry is roughly worth 40bn. Black Myth: Wukong, produced by developer Game Science (GS), has already generated an estimated 800-900m in revenue to date and will help project Chinese culture to a global audience. The game, believed to be China's first AAA video game, was developed at a reported cost of about 70m over six years. AAA is a classification used to denote a high-budget or high-profile game from a large video game developer.
Topological Tensor Eigenvalue Theorems in Data Fusion
This paper introduces a novel framework for tensor eigenvalue analysis in the context of multi-modal data fusion, leveraging topological invariants such as Betti numbers. While traditional approaches to tensor eigenvalues rely on algebraic extensions of matrix theory, this work provides a topological perspective that enriches the understanding of tensor structures. By establishing new theorems linking eigenvalues to topological features, the proposed framework offers deeper insights into the latent structure of data, enhancing both interpretability and robustness. Applications to data fusion illustrate the theoretical and practical significance of the approach, demonstrating its potential for broad impact across machine learning and data science domains.
Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAM Empowerment
Hu, Xin, Wang, Janet, Hamm, Jihun, Yotsu, Rie R, Ding, Zhengming
Current AI-assisted skin image diagnosis has achieved dermatologist-level performance in classifying skin cancer, driven by rapid advancements in deep learning architectures. However, unlike traditional vision tasks, skin images in general present unique challenges due to the limited availability of well-annotated datasets, complex variations in conditions, and the necessity for detailed interpretations to ensure patient safety. Previous segmentation methods have sought to reduce image noise and enhance diagnostic performance, but these techniques require fine-grained, pixel-level ground truth masks for training. In contrast, with the rise of foundation models, the Segment Anything Model (SAM) has been introduced to facilitate promptable segmentation, enabling the automation of the segmentation process with simple yet effective prompts. Efforts applying SAM predominantly focus on dermatoscopy images, which present more easily identifiable lesion boundaries than clinical photos taken with smartphones. This limitation constrains the practicality of these approaches to real-world applications. To overcome the challenges posed by noisy clinical photos acquired via non-standardized protocols and to improve diagnostic accessibility, we propose a novel Cross-Attentive Fusion framework for interpretable skin lesion diagnosis. Our method leverages SAM to generate visual concepts for skin diseases using prompts, integrating local visual concepts with global image features to enhance model performance. Extensive evaluation on two skin disease datasets demonstrates our proposed method's effectiveness on lesion diagnosis and interpretability.
Integrating Large Language Models into a Tri-Modal Architecture for Automated Depression Classification
Major Depressive Disorder (MDD) is a pervasive mental health condition that affects 300 million people worldwide. This work presents a novel, BiLSTM-based tri-modal model-level fusion architecture for the binary classification of depression from clinical interview recordings. The proposed architecture incorporates Mel Frequency Cepstral Coefficients, Facial Action Units, and uses a two-shot learning based GPT-4 model to process text data. This is the first work to incorporate large language models into a multi-modal architecture for this task. It achieves impressive results on the DAIC-WOZ AVEC 2016 Challenge cross-validation split and Leave-One-Subject-Out cross-validation split, surpassing all baseline models and multiple state-of-the-art models. In Leave-One-Subject-Out testing, it achieves an accuracy of 91.01%, an F1-Score of 85.95%, a precision of 80%, and a recall of 92.86%.
Bias Begets Bias: The Impact of Biased Embeddings on Diffusion Models
Kuchlous, Sahil, Li, Marvin, Wang, Jeffrey G.
With the growing adoption of Text-to-Image (TTI) systems, the social biases of these models have come under increased scrutiny. Herein we conduct a systematic investigation of one such source of bias for diffusion models: embedding spaces. First, because traditional classifier-based fairness definitions require true labels not present in generative modeling, we propose statistical group fairness criteria based on a model's internal representation of the world. Using these definitions, we demonstrate theoretically and empirically that an unbiased text embedding space for input prompts is a necessary condition for representationally balanced diffusion models, meaning the distribution of generated images satisfy diversity requirements with respect to protected attributes. Next, we investigate the impact of biased embeddings on evaluating the alignment between generated images and prompts, a process which is commonly used to assess diffusion models. We find that biased multimodal embeddings like CLIP can result in lower alignment scores for representationally balanced TTI models, thus rewarding unfair behavior. Finally, we develop a theoretical framework through which biases in alignment evaluation can be studied and propose bias mitigation methods. By specifically adapting the perspective of embedding spaces, we establish new fairness conditions for diffusion model development and evaluation.
ValueCompass: A Framework of Fundamental Values for Human-AI Alignment
Shen, Hua, Knearem, Tiffany, Ghosh, Reshmi, Yang, Yu-Ju, Mitra, Tanushree, Huang, Yun
As AI systems become more advanced, ensuring their alignment with a diverse range of individuals and societal values becomes increasingly critical. But how can we capture fundamental human values and assess the degree to which AI systems align with them? We introduce ValueCompass, a framework of fundamental values, grounded in psychological theory and a systematic review, to identify and evaluate human-AI alignment. We apply ValueCompass to measure the value alignment of humans and language models (LMs) across four real-world vignettes: collaborative writing, education, public sectors, and healthcare. Our findings uncover risky misalignment between humans and LMs, such as LMs agreeing with values like "Choose Own Goals", which are largely disagreed by humans. We also observe values vary across vignettes, underscoring the necessity for context-aware AI alignment strategies. This work provides insights into the design space of human-AI alignment, offering foundations for developing AI that responsibly reflects societal values and ethics.
On the Generalizability of Foundation Models for Crop Type Mapping
Chang, Yi-Chia, Stewart, Adam J., Bastani, Favyen, Wolters, Piper, Kannan, Shreya, Huber, George R., Wang, Jingtong, Banerjee, Arindam
Foundation models pre-trained using self-supervised and weakly-supervised learning have shown powerful transfer learning capabilities on various downstream tasks, including language understanding, text generation, and image recognition. Recently, the Earth observation (EO) field has produced several foundation models pre-trained directly on multispectral satellite imagery (e.g., Sentinel-2) for applications like precision agriculture, wildfire and drought monitoring, and natural disaster response. However, few studies have investigated the ability of these models to generalize to new geographic locations, and potential concerns of geospatial bias -- models trained on data-rich developed countries not transferring well to data-scarce developing countries -- remain. We investigate the ability of popular EO foundation models to transfer to new geographic regions in the agricultural domain, where differences in farming practices and class imbalance make transfer learning particularly challenging. We first select six crop classification datasets across five continents, normalizing for dataset size and harmonizing classes to focus on four major cereal grains: maize, soybean, rice, and wheat. We then compare three popular foundation models, pre-trained on SSL4EO-S12, SatlasPretrain, and ImageNet, using in-distribution (ID) and out-of-distribution (OOD) evaluation. Experiments show that pre-trained weights designed explicitly for Sentinel-2, such as SSL4EO-S12, outperform general pre-trained weights like ImageNet. Furthermore, the benefits of pre-training on OOD data are the most significant when only 10--100 ID training samples are used. Transfer learning and pre-training with OOD and limited ID data show promising applications, as many developing regions have scarce crop type labels. All harmonized datasets and experimental code are open-source and available for download.
China opts out of international blueprint to stop AI race in weapons development
China this week chose not to sign onto an international "blueprint" agreed to by some 60 nations, including the U.S., that looked to establish guardrails when employing artificial intelligence (AI) for military use. More than 90 nations attended the Responsible Artificial Intelligence in the Military Domain (REAIM) summit hosted in South Korea on Monday and Tuesday, though roughly a third of the attendees did not support the nonbinding proposal. AI expert Arthur Herman, senior fellow and director of the Quantum Alliance Initiative with the Hudson Institute, told Fox News Digital that the fact some 30 nations opted out of this important development in the race to develop AI is not necessarily cause for concern, though in Beijing's case it is likely because of its general opposition to signing multilateral agreements. Participants are shown prior to the closing session of the REAIM summit in Seoul, South Korea, on Sept. 10, 2024. "What it boils down to … is China is always wary of any kind of international agreement in which it has not been the architect or involved in creating and organizing how that agreement is going to be shaped and implemented," he said.
Teenager invents robot to solve Rubik's Cube
Teenager invents robot to solve Rubik's Cube BBCRuarcc the year 10 student who has programmed a robot that can solve a Rubik's Cube puzzle A 13-year-old schoolboy has invented a Lego robot that can solve a Rubik's cube. Ruarcc, from St Malachy's College in north Belfast, first took steps to create puzzle-solving robot prototypes in his second year at school, aged 12. This was made possible after the school launched its creative digital technology hub (CDTH) last year. Teacher Clare McGrath commented she "didn't believe" that Ruarcc's robot would work at first.'People are amazed my robot can solve Rubik's Cube' Ruarcc told BBC News NI it was "frustrating", but he worked on making it better. "People tend to be amazed that it can solve one," he said.