Africa
dzFinNlp at AraFinNLP: Improving Intent Detection in Financial Conversational Agents
Lichouri, Mohamed, Lounnas, Khaled, Amziane, Mohamed Zakaria
Memory (LSTM) networks (Firdaus et al., 2021) The Arabic Financial NLP (AraFinNLP) shared and their bidirectional variants (BiLSTM) (Sreelakshmi task highlights the increasing importance of advanced et al., 2018), has provided more nuanced Natural Language Processing (NLP) tools understanding by capturing the sequential nature tailored for the financial sector in the Arab world. of text. More recently, transformer-based models, This initiative is particularly timely given the substantial like BERT (Alshahrani et al., 2022), have set new growth of Middle Eastern stock markets, benchmarks in NLP by leveraging self-attention driven by diverse sectors across the region. This mechanisms to understand contextual relationships economic expansion underscores the need for sophisticated within text, making them particularly effective for financial NLP systems capable of handling complex tasks like intent detection across varied the unique linguistic and cultural nuances of dialects.
dzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformers
Lichouri, Mohamed, Lounnas, Khaled, Ouaras, Khelil Rafik, Abi, Mohamed, Guechtouli, Anis
This study compares Term Frequency-Inverse Document Frequency (TF-IDF) features with Sentence Transformers for detecting writers' stances--favorable, opposing, or neutral--towards three significant topics: COVID-19 vaccine, digital transformation, and women empowerment. Through empirical evaluation, we demonstrate that Sentence Transformers outperform TF-IDF features across various experimental setups. Our team, dzStance, participated in a stance detection competition, achieving the 13th position (74.91%) among 15 teams in Women Empowerment, 10th (73.43%) in COVID Vaccine, and 12th (66.97%) in Digital Transformation. Overall, our team's performance ranked 13th (71.77%) among all participants. Notably, our approach achieved promising F1-scores, highlighting its effectiveness in identifying writers' stances on diverse topics. These results underscore the potential of Sentence Transformers to enhance stance detection models for addressing critical societal issues.
Iran's assassination plot against Trump latest attempt to kill Americans on US soil
JERUSALEM - The Iranian regime's plot to assassinate former President Trump is the latest in a string of attempts by Tehran to lethally target American officials and Iranian American dissidents. Iranian Supreme Leader Ali Khamenei has effectively put bounties on the heads of Trump, his former Secretary of State Mike Pompeo and ex-National Security Advisor John Bolton for their roles in the U.S. drone strike that eliminated the global Iranian terrorist Qassem Soleimani in 2020. According to the U.S. government, Soleimani was responsible for the murders of over 600 American military personnel in the Middle East. BOLTON CALLS IRAN ASSASSINATION PLOT AN'ACT OF WAR,' CALLS ON BIDEN ADMIN TO'TERMINATE' NUCLEAR TALKS Former President Trump, left, and Iranian leader Ali Khamenei. Fox News Digital reported on Tuesday that the Department of Homeland Security received intelligence from a human source about the planned Iranian assassination of Trump.
AlcLaM: Arabic Dialectal Language Model
Ahmed, Murtadha, Alfasly, Saghir, Wen, Bo, Qasem, Jamaal, Ahmed, Mohammed, Liu, Yunfeng
These models significantly enhance Arabic Pre-trained Language Models (PLMs) utilizing selfsupervised NLP tasks over multilingual models. However, learning techniques, such as BERT (Devlin they are predominantly trained on Modern Standard et al., 2018a) and RoBERTa (Liu et al., 2019), Arabic (MSA) datasets. This focus on MSA have become pivotal in advancing the field of introduces two primary limitations: first, there is natural language processing (NLP) through transfer reduced recognition of dialectal tokens, which vary learning. These models have significantly enhanced widely across different Arabic-speaking regions; performance across a variety of NLP tasks second, there is a biased weighting towards MSA by leveraging vast amounts of textual data and extensive tokens in the models, which may not accurately computational resources. However, the necessity reflect the linguistic nuances present in everyday for large corpora and the substantial computational Arabic usage.
Deep Learning-based Sentiment Analysis of Olympics Tweets
Bandyopadhyay, Indranil, Karmakar, Rahul
Sentiment analysis (SA), is an approach of natural language processing (NLP) for determining a text's emotional tone by analyzing subjective information such as views, feelings, and attitudes toward specific topics, products, services, events, or experiences. This study attempts to develop an advanced deep learning (DL) model for SA to understand global audience emotions through tweets in the context of the Olympic Games. The findings represent global attitudes around the Olympics and contribute to advancing the SA models. We have used NLP for tweet pre-processing and sophisticated DL models for arguing with SA, this research enhances the reliability and accuracy of sentiment classification. The study focuses on data selection, preprocessing, visualization, feature extraction, and model building, featuring a baseline Na\"ive Bayes (NB) model and three advanced DL models: Convolutional Neural Network (CNN), Bidirectional Long Short-Term Memory (BiLSTM), and Bidirectional Encoder Representations from Transformers (BERT). The results of the experiments show that the BERT model can efficiently classify sentiments related to the Olympics, achieving the highest accuracy of 99.23%.
A survey and taxonomy of methods interpreting random forest models
Haddouchi, Maissae, Berrado, Abdelaziz
The interpretability of random forest (RF) models is a research topic of growing interest in the machine learning (ML) community. In the state of the art, RF is considered a powerful learning ensemble given its predictive performance, flexibility, and ease of use. Furthermore, the inner process of the RF model is understandable because it uses an intuitive and intelligible approach for building the RF decision tree ensemble. However, the RF resulting model is regarded as a "black box" because of its numerous deep decision trees. Gaining visibility over the entire process that induces the final decisions by exploring each decision tree is complicated, if not impossible. This complexity limits the acceptance and implementation of RF models in several fields of application. Several papers have tackled the interpretation of RF models. This paper aims to provide an extensive review of methods used in the literature to interpret RF resulting models. We have analyzed these methods and classified them based on different axes. Although this review is not exhaustive, it provides a taxonomy of various techniques that should guide users in choosing the most appropriate tools for interpreting RF models, depending on the interpretability aspects sought. It should also be valuable for researchers who aim to focus their work on the interpretability of RF or ML black boxes in general.
The Role of Network and Identity in the Diffusion of Hashtags
Ananthasubramaniam, Aparna, Zhu, Yufei, Jurgens, David, Romero, Daniel
Although the spread of behaviors is influenced by many social factors, existing literature tends to study the effects of single factors -- most often, properties of the social network -- on the final cascade. In order to move towards a more integrated view of cascades, this paper offers the first comprehensive investigation into the role of two social factors in the diffusion of 1,337 popular hashtags representing the production of novel culture on Twitter: 1) the topology of the Twitter social network and 2) performance of each user's probable demographic identity. Here, we show that cascades are best modeled using a combination of network and identity, rather than either factor alone. This combined model best reproduces a composite index of ten cascade properties across all 1,337 hashtags. However, there is important heterogeneity in what social factors are required to reproduce different properties of hashtag cascades. For instance, while a combined network+identity model best predicts the popularity of cascades, a network-only model has better performance in predicting cascade growth and an identity-only model in adopter composition. We are able to predict what type of hashtag is best modeled by each combination of features and use this to further improve performance. Additionally, consistent with prior literature on the combined network+identity model most outperforms the single-factor counterfactuals among hashtags used for expressing racial or regional identity, stance-taking, talking about sports, or variants of existing cultural trends with very slow- or fast-growing communicative need. In sum, our results imply the utility of multi-factor models in predicting cascades, in order to account for the varied ways in which network, identity, and other social factors play a role in the diffusion of hashtags on Twitter.
ModalChorus: Visual Probing and Alignment of Multi-modal Embeddings via Modal Fusion Map
Ye, Yilin, Xiao, Shishi, Zeng, Xingchen, Zeng, Wei
Multi-modal embeddings form the foundation for vision-language models, such as CLIP embeddings, the most widely used text-image embeddings. However, these embeddings are vulnerable to subtle misalignment of cross-modal features, resulting in decreased model performance and diminished generalization. To address this problem, we design ModalChorus, an interactive system for visual probing and alignment of multi-modal embeddings. ModalChorus primarily offers a two-stage process: 1) embedding probing with Modal Fusion Map (MFM), a novel parametric dimensionality reduction method that integrates both metric and nonmetric objectives to enhance modality fusion; and 2) embedding alignment that allows users to interactively articulate intentions for both point-set and set-set alignments. Quantitative and qualitative comparisons for CLIP embeddings with existing dimensionality reduction (e.g., t-SNE and MDS) and data fusion (e.g., data context map) methods demonstrate the advantages of MFM in showcasing cross-modal features over common vision-language datasets. Case studies reveal that ModalChorus can facilitate intuitive discovery of misalignment and efficient re-alignment in scenarios ranging from zero-shot classification to cross-modal retrieval and generation.
LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
Zhang, Kaichen, Li, Bo, Zhang, Peiyuan, Pu, Fanyi, Cahyono, Joshua Adrian, Hu, Kairui, Liu, Shuai, Zhang, Yuanhan, Yang, Jingkang, Li, Chunyuan, Liu, Ziwei
The advances of large foundation models necessitate wide-coverage, low-cost, and zero-contamination benchmarks. Despite continuous exploration of language model evaluations, comprehensive studies on the evaluation of Large Multi-modal Models (LMMs) remain limited. In this work, we introduce LMMS-EVAL, a unified and standardized multimodal benchmark framework with over 50 tasks and more than 10 models to promote transparent and reproducible evaluations. Although LMMS-EVAL offers comprehensive coverage, we find it still falls short in achieving low cost and zero contamination. To approach this evaluation trilemma, we further introduce LMMS-EVAL LITE, a pruned evaluation toolkit that emphasizes both coverage and efficiency. Additionally, we present Multimodal LIVEBENCH that utilizes continuously updating news and online forums to assess models' generalization abilities in the wild, featuring a low-cost and zero-contamination evaluation approach. In summary, our work highlights the importance of considering the evaluation trilemma and provides practical solutions to navigate the trade-offs in evaluating large multi-modal models, paving the way for more effective and reliable benchmarking of LMMs. We opensource our codebase and maintain leaderboard of LIVEBENCH at https://github.com/EvolvingLMMs-Lab/lmms-eval and https://huggingface.co/spaces/lmms-lab/LiveBench.
AudienceView: AI-Assisted Interpretation of Audience Feedback in Journalism
Brannon, William, Beeferman, Doug, Jiang, Hang, Heyward, Andrew, Roy, Deb
Understanding and making use of audience feedback is important but difficult for journalists, who now face an impractically large volume of audience comments online. We introduce AudienceView, an online tool to help journalists categorize and interpret this feedback by leveraging large language models (LLMs). AudienceView identifies themes and topics, connects them back to specific comments, provides ways to visualize the sentiment and distribution of the comments, and helps users develop ideas for subsequent reporting projects. We consider how such tools can be useful in a journalist's workflow, and emphasize the importance of contextual awareness and human judgment.