Goto

Collaborating Authors

 Media


Understanding Position Bias Effects on Fairness in Social Multi-Document Summarization

arXiv.org Artificial Intelligence

Text summarization models have typically focused on optimizing aspects of quality such as fluency, relevance, and coherence, particularly in the context of news articles. However, summarization models are increasingly being used to summarize diverse sources of text, such as social media data, that encompass a wide demographic user base. It is thus crucial to assess not only the quality of the generated summaries, but also the extent to which they can fairly represent the opinions of diverse social groups. Position bias, a long-known issue in news summarization, has received limited attention in the context of social multi-document summarization. We deeply investigate this phenomenon by analyzing the effect of group ordering in input documents when summarizing tweets from three distinct linguistic communities: African-American English, Hispanic-aligned Language, and White-aligned Language. Our empirical analysis shows that although the textual quality of the summaries remains consistent regardless of the input document order, in terms of fairness, the results vary significantly depending on how the dialect groups are presented in the input data. Our results suggest that position bias manifests differently in social multi-document summarization, severely impacting the fairness of summarization models.


MiniGPT-3D: Efficiently Aligning 3D Point Clouds with Large Language Models using 2D Priors

arXiv.org Artificial Intelligence

Large 2D vision-language models (2D-LLMs) have gained significant attention by bridging Large Language Models (LLMs) with images using a simple projector. Inspired by their success, large 3D point cloud-language models (3D-LLMs) also integrate point clouds into LLMs. However, directly aligning point clouds with LLM requires expensive training costs, typically in hundreds of GPU-hours on A100, which hinders the development of 3D-LLMs. In this paper, we introduce MiniGPT-3D, an efficient and powerful 3D-LLM that achieves multiple SOTA results while training for only 27 hours on one RTX 3090. Specifically, we propose to align 3D point clouds with LLMs using 2D priors from 2D-LLMs, which can leverage the similarity between 2D and 3D visual information. We introduce a novel four-stage training strategy for modality alignment in a cascaded way, and a mixture of query experts module to adaptively aggregate features with high efficiency. Moreover, we utilize parameter-efficient fine-tuning methods LoRA and Norm fine-tuning, resulting in only 47.8M learnable parameters, which is up to 260x fewer than existing methods. Extensive experiments show that MiniGPT-3D achieves SOTA on 3D object classification and captioning tasks, with significantly cheaper training costs. Notably, MiniGPT-3D gains an 8.12 increase on GPT-4 evaluation score for the challenging object captioning task compared to ShapeLLM-13B, while the latter costs 160 total GPU-hours on 8 A800. We are the first to explore the efficient 3D-LLM, offering new insights to the community. Code and weights are available at https://github.com/TangYuan96/MiniGPT-3D.


Large Language Models for UAVs: Current State and Pathways to the Future

arXiv.org Artificial Intelligence

Unmanned Aerial Vehicles (UAVs) have emerged as a transformative technology across diverse sectors, offering adaptable solutions to complex challenges in both military and civilian domains. Their expanding capabilities present a platform for further advancement by integrating cutting-edge computational tools like Artificial Intelligence (AI) and Machine Learning (ML) algorithms. These advancements have significantly impacted various facets of human life, fostering an era of unparalleled efficiency and convenience. Large Language Models (LLMs), a key component of AI, exhibit remarkable learning and adaptation capabilities within deployed environments, demonstrating an evolving form of intelligence with the potential to approach human-level proficiency. This work explores the significant potential of integrating UAVs and LLMs to propel the development of autonomous systems. We comprehensively review LLM architectures, evaluating their suitability for UAV integration. Additionally, we summarize the state-of-the-art LLM-based UAV architectures and identify novel opportunities for LLM embedding within UAV frameworks. Notably, we focus on leveraging LLMs to refine data analysis and decision-making processes, specifically for enhanced spectral sensing and sharing in UAV applications. Furthermore, we investigate how LLM integration expands the scope of existing UAV applications, enabling autonomous data processing, improved decision-making, and faster response times in emergency scenarios like disaster response and network restoration. Finally, we highlight crucial areas for future research that are critical for facilitating the effective integration of LLMs and UAVs.


The insect farmers turning to AI to help lower costs

BBC News

Some 5,000 miles away in Lithuania, insect farm software provider Cogastro is also working on an AI-based system. It currently sells monitoring software that automatically collects data for users to analyse, but the AI upgrade will enable to system to learn, adapt and make changes inside an insect farm for itself.


Fox News AI Newsletter: Jobs AI can't take

FOX News

Mehmet Aytekin, 28, left, checks his cell phone while waiting to board his United Airlines flight to Newark, N.J. at O'Hare International Airport on Jan. 3, 2020. Amid high costs and controversies surrounding college education โ€“ coupled with the threat that artificial intelligence poses on certain white-collar jobs โ€“ much of Gen Z is leaning toward pursuing trade schools and blue-collar jobs with that tech gap in mind. IN ITS'PRIME': Amazon.com reported record first-quarter sales as the AI boom powered growth in its cloud-computing unit, helping the company continue to shake off last year's post-pandemic slump. FUTURE'S NOT SET: Policymakers should not reference or rely on fictional scenarios as reasons to regulate AI. Otherwise, America risks losing its global lead on AI and American citizens could never realize the full benefits of the technology.


FKA twigs Creates Deepfake AI Version of Herself With a Special Use in Mind

TIME - Tech

British singer-songwriter FKA twigs, born Tahliah Debrett Barnett, testified before the U.S. Senate Judiciary Subcommittee on Intellectual Property on Tuesday about the dangers of artificial intelligence. She relayed that she was especially concerned as an artist whose music and performances are used by third parties to train artificial intelligence models. She said that the power of this technology has become especially apparent to her as she has attempted to build a deepfake version of herself. "In the past year, I have developed my own deepfake version of myself that is not only trained in my personality, but also can use my exact tone of voice to speak many languages," the singer said in her statement. "I will be engaging my'AI twigs' later this year to extend my reach and handle my online social media interactions, whilst I continue to focus on my art from the comfort and solace of my studio."


Microsoft and OpenAI sued yet again by Chicago Tribune and New York Daily News

Engadget

A group of publications that include the Chicago Tribune, New York Daily News and the Orlando Sentinel are suing Microsoft and OpenAI, as reported by The Verge. Their products can regurgitate Times' articles verbatim and can "mimic its expressive style," the publication said, even though they didn't have a prior licensing agreement. In a motion seeking to dismiss key parts of the lawsuit, Microsoft accused the Times of doomsday futurology by claiming that generative AI can pose a threat to independent journalism. ACG's newspapers complain of the same thing, that the companies' chatbots are reproducing their articles word-for-word shortly after they're published without a prominent link back to the sources. They included several examples in their complaint.


Brazil's last Japanese-language newspaper innovates to stay in print

The Japan Times

Diario Brasil Nippou, the last remaining Japanese-language newspaper in Brazil, is struggling to keep its presses rolling. The South American country is home to the largest Japanese community outside the East Asian nation, with some 2.7 million Nikkei Japanese immigrants and their descendants. Behind the difficulties facing the paper is a decline in the number of subscribers, partly reflecting the aging of immigrants from Japan.


Uncovering Agendas: A Novel French & English Dataset for Agenda Detection on Social Media

arXiv.org Artificial Intelligence

The behavior and decision making of groups or communities can be dramatically influenced by individuals pushing particular agendas, e.g., to promote or disparage a person or an activity, to call for action, etc.. In the examination of online influence campaigns, particularly those related to important political and social events, scholars often concentrate on identifying the sources responsible for setting and controlling the agenda (e.g., public media). In this article we present a methodology for detecting specific instances of agenda control through social media where annotated data is limited or non-existent. By using a modest corpus of Twitter messages centered on the 2022 French Presidential Elections, we carry out a comprehensive evaluation of various approaches and techniques that can be applied to this problem. Our findings demonstrate that by treating the task as a textual entailment problem, it is possible to overcome the requirement for a large annotated training dataset.


Addressing Topic Granularity and Hallucination in Large Language Models for Topic Modelling

arXiv.org Artificial Intelligence

Large language models (LLMs) with their strong zero-shot topic extraction capabilities offer an alternative to probabilistic topic modelling and closed-set topic classification approaches. As zero-shot topic extractors, LLMs are expected to understand human instructions to generate relevant and non-hallucinated topics based on the given documents. However, LLM-based topic modelling approaches often face difficulties in generating topics with adherence to granularity as specified in human instructions, often resulting in many near-duplicate topics. Furthermore, methods for addressing hallucinated topics generated by LLMs have not yet been investigated. In this paper, we focus on addressing the issues of topic granularity and hallucinations for better LLM-based topic modelling. To this end, we introduce a novel approach that leverages Direct Preference Optimisation (DPO) to fine-tune open-source LLMs, such as Mistral-7B. Our approach does not rely on traditional human annotation to rank preferred answers but employs a reconstruction pipeline to modify raw topics generated by LLMs, thus enabling a fast and efficient training and inference framework. Comparative experiments show that our fine-tuning approach not only significantly improves the LLM's capability to produce more coherent, relevant, and precise topics, but also reduces the number of hallucinated topics.