Media
Can Large Language Models Detect Rumors on Social Media?
Liu, Qiang, Tao, Xiang, Wu, Junfei, Wu, Shu, Wang, Liang
In this work, we investigate to use Large Language Models (LLMs) for rumor detection on social media. However, it is challenging for LLMs to reason over the entire propagation information on social media, which contains news contents and numerous comments, due to LLMs may not concentrate on key clues in the complex propagation information, and have trouble in reasoning when facing massive and redundant information. Accordingly, we propose an LLM-empowered Rumor Detection (LeRuD) approach, in which we design prompts to teach LLMs to reason over important clues in news and comments, and divide the entire propagation information into a Chain-of-Propagation for reducing LLMs' burden. We conduct extensive experiments on the Twitter and Weibo datasets, and LeRuD outperforms several state-of-the-art rumor detection models by 3.2% to 7.7%. Meanwhile, by applying LLMs, LeRuD requires no data for training, and thus shows more promising rumor detection ability in few-shot or zero-shot scenarios.
Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challenges
Franceschelli, Giorgio, Musolesi, Mirco
Generative Artificial Intelligence (AI) is one of the most exciting developments in Computer Science of the last decade. At the same time, Reinforcement Learning (RL) has emerged as a very successful paradigm for a variety of machine learning tasks. In this survey, we discuss the state of the art, opportunities and open research questions in applying RL to generative AI. In particular, we will discuss three types of applications, namely, RL as an alternative way for generation without specified objectives; as a way for generating outputs while concurrently maximizing an objective function; and, finally, as a way of embedding desired characteristics, which cannot be easily captured by means of an objective function, into the generative process. We conclude the survey with an in-depth discussion of the opportunities and challenges in this fascinating emerging area.
Confessions of an AI Clickbait Kingpin
"I'm not a fan of AI," Nebojša Vujinović Vujo says. The admission surprises me: He has built a bustling business by snapping up abandoned news outlets and other websites and stuffing them full of algorithmically generated articles. Although he accepts that his model rankles writers and readers alike, he says he's simply embracing an unstoppable new tool--large language models--in the same way people rationally swapped horse-drawn buggies for gas-powered vehicles. They're making my planet bad," he says. I connected with Vujo after digging into the strange afterlife of indie women's blog The Hairpin, which shut down in 2018. In place of the voicey, funny blog posts it was known for, the site began churning out AI-generated, search-engine-optimized pablum about dream interpretations and painfully generic relationship advice like "effective communication is vital." When I emailed an address listed on the zombie site's About Us page, Vujo responded, claiming that it was just one of more than 2,000 sites he operates, in an AI-content-fueled fiefdom built by acquiring once-popular domains fallen on hard times. He's the CEO of the digital marketing firm Shantel, which monetizes its AI-populated sites through programmatic ads, sponsored content, and selling the placement of "backlinks" to website owners trying to boost their credibility with search engines. He often targets distressed media sites because they have built-in audiences and a history of ranking highly in search results. The foundation of that business is a long-established practice known as domain squatting--buying up web domains that once belonged to established brands and profiting off their reputations with Google and other search engines. Lily Ray, senior director of SEO at the marketing agency Ampsive, calls it "the underbelly of the SEO industry." But Vujo is part of a wave of entrepreneurs giving this old trade a new twist by using generative AI. It's dusk where I live in Chicago when I talk via Zoom with Nebojša Vujinović Vujo. It's midnight in Belgrade, Serbia, where he lives with his girlfriend and their toddler, but he's wide awake and chatty. Vujo attributes his erratic sleep schedule to years of late nights working as a DJ and still makes music--he likes to mix pop with Balkan folk and is working on a new song called "Fat Lady." But right now he's eager to talk, human-to-human, about his AI-fueled hustle. He gets why writers are unhappy that their work has been erased and replaced by clickbait. But he defends his choices, pointing out that his life has been tougher than that of the average American blogger. Although ethnically Serbian, Vujo was born in what is now known as Bosnia and Herzegovina, and his family fled during the breakup of Yugoslavia. "I had two wars I escaped.
ChatGPT will digitally tag images generated by DALL-E 3 to help battle misinformation
In an age where fraudsters are using generative AI to scam money or tarnish one's reputation, tech firms are coming up with methods to help users verify content -- at least still images, to begin with. As teased in its 2024 misinformation strategy, OpenAI is now including provenance metadata in images generated with ChatGPT on the web and DALL-E 3 API, with their mobile counterparts receiving the same upgrade by February 12. The metadata follows the C2PA (Coalition for Content Provenance and Authenticity) open standard, and when one such image is uploaded to the Content Credentials Verify tool, you'll be able to trace its provenance lineage. For instance, an image generated using ChatGPT will show an initial metadata manifest indicating its DALL-E 3 API origin, followed by a second metadata manifest showing that it surfaced in ChatGPT. Despite the fancy cryptographic tech behind the C2PA standard, this verification method only works when the metadata is intact; the tool is of no use if you upload an AI-generated image sans metadata -- as is the case with any screenshot or uploaded image on social media.
Counterfactual Image Editing
Counterfactual image editing is an important task in generative AI, which asks how an image would look if certain features were different. The current literature on the topic focuses primarily on changing individual features while remaining silent about the causal relationships between these features, as present in the real world. In this paper, we formalize the counterfactual image editing task using formal language, modeling the causal relationships between latent generative factors and images through a special type of model called augmented structural causal models (ASCMs). Second, we show two fundamental impossibility results: (1) counterfactual editing is impossible from i.i.d. image samples and their corresponding labels alone; (2) even when the causal relationships between the latent generative factors and images are available, no guarantees regarding the output of the model can be provided. Third, we propose a relaxation for this challenging problem by approximating non-identifiable counterfactual distributions with a new family of counterfactual-consistent estimators. This family exhibits the desirable property of preserving features that the user cares about across both factual and counterfactual worlds. Finally, we develop an efficient algorithm to generate counterfactual images by leveraging neural causal models.
The Role of LLMs in Sustainable Smart Cities: Applications, Challenges, and Future Directions
Ullah, Amin, Qi, Guilin, Hussain, Saddam, Ullah, Irfan, Ali, Zafar
Smart cities stand as pivotal components in the ongoing pursuit of elevating urban living standards, facilitating the rapid expansion of urban areas while efficiently managing resources through sustainable and scalable innovations. In this regard, as emerging technologies like Artificial Intelligence (AI), the Internet of Things (IoT), big data analytics, and fog and edge computing have become increasingly prevalent, smart city applications grapple with various challenges, including the potential for unauthorized disclosure of confidential and sensitive data. The seamless integration of emerging technologies has played a vital role in sustaining the dynamic pace of their development. This paper explores the substantial potential and applications of Deep Learning (DL), Federated Learning (FL), IoT, Blockchain, Natural Language Processing (NLP), and large language models (LLMs) in optimizing ICT processes within smart cities. We aim to spotlight the vast potential of these technologies as foundational elements that technically strengthen the realization and advancement of smart cities, underscoring their significance in driving innovation within this transformative urban milieu. Our discourse culminates with an exploration of the formidable challenges that DL, FL, IoT, Blockchain, NLP, and LLMs face within these contexts, and we offer insights into potential future directions.
Giving Robots a Voice: Human-in-the-Loop Voice Creation and open-ended Labeling
van Rijn, Pol, Mertes, Silvan, Janowski, Kathrin, Weitz, Katharina, Jacoby, Nori, André, Elisabeth
Speech is a natural interface for humans to interact with robots. Yet, aligning a robot's voice to its appearance is challenging due to the rich vocabulary of both modalities. Previous research has explored a few labels to describe robots and tested them on a limited number of robots and existing voices. Here, we develop a robot-voice creation tool followed by large-scale behavioral human experiments (N=2,505). First, participants collectively tune robotic voices to match 175 robot images using an adaptive human-in-the-loop pipeline. Then, participants describe their impression of the robot or their matched voice using another human-in-the-loop paradigm for open-ended labeling. The elicited taxonomy is then used to rate robot attributes and to predict the best voice for an unseen robot. We offer a web interface to aid engineers in customizing robot voices, demonstrating the synergy between cognitive science and machine learning for engineering tools.
LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views
Roh, Yuji, Liu, Qingyun, Gui, Huan, Yuan, Zhe, Tang, Yujin, Whang, Steven Euijong, Liu, Liang, Bi, Shuchao, Hong, Lichan, Chi, Ed H., Zhao, Zhe
Fine-tuning is becoming widely used for leveraging the power of pre-trained foundation models in new downstream tasks. While there are many successes of fine-tuning on various tasks, recent studies have observed challenges in the generalization of fine-tuned models to unseen distributions (i.e., out-of-distribution; OOD). To improve OOD generalization, some previous studies identify the limitations of fine-tuning data and regulate fine-tuning to preserve the general representation learned from pre-training data. However, potential limitations in the pre-training data and models are often ignored. In this paper, we contend that overly relying on the pre-trained representation may hinder fine-tuning from learning essential representations for downstream tasks and thus hurt its OOD generalization. It can be especially catastrophic when new tasks are from different (sub)domains compared to pre-training data. To address the issues in both pre-training and fine-tuning data, we propose a novel generalizable fine-tuning method LEVI, where the pre-trained model is adaptively ensembled layer-wise with a small task-specific model, while preserving training and inference efficiencies. By combining two complementing models, LEVI effectively suppresses problematic features in both the fine-tuning data and pre-trained model and preserves useful features for new tasks. Broad experiments with large language and vision models show that LEVI greatly improves fine-tuning generalization via emphasizing different views from fine-tuning data and pre-trained features.
The Future of Cognitive Strategy-enhanced Persuasive Dialogue Agents: New Perspectives and Trends
Chen, Mengqi, Guo, Bin, Wang, Hao, Li, Haoyu, Zhao, Qian, Liu, Jingqi, Ding, Yasan, Pan, Yan, Yu, Zhiwen
Persuasion, as one of the crucial abilities in human communication, has garnered extensive attention from researchers within the field of intelligent dialogue systems. We humans tend to persuade others to change their viewpoints, attitudes or behaviors through conversations in various scenarios (e.g., persuasion for social good, arguing in online platforms). Developing dialogue agents that can persuade others to accept certain standpoints is essential to achieving truly intelligent and anthropomorphic dialogue system. Benefiting from the substantial progress of Large Language Models (LLMs), dialogue agents have acquired an exceptional capability in context understanding and response generation. However, as a typical and complicated cognitive psychological system, persuasive dialogue agents also require knowledge from the domain of cognitive psychology to attain a level of human-like persuasion. Consequently, the cognitive strategy-enhanced persuasive dialogue agent (defined as CogAgent), which incorporates cognitive strategies to achieve persuasive targets through conversation, has become a predominant research paradigm. To depict the research trends of CogAgent, in this paper, we first present several fundamental cognitive psychology theories and give the formalized definition of three typical cognitive strategies, including the persuasion strategy, the topic path planning strategy, and the argument structure prediction strategy. Then we propose a new system architecture by incorporating the formalized definition to lay the foundation of CogAgent. Representative works are detailed and investigated according to the combined cognitive strategy, followed by the summary of authoritative benchmarks and evaluation metrics. Finally, we summarize our insights on open issues and future directions of CogAgent for upcoming researchers.
Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classification
Faye, Géraud, Icard, Benjamin, Casanova, Morgane, Chanson, Julien, Maine, François, Bancilhon, François, Gadek, Guillaume, Gravier, Guillaume, Égré, Paul
This paper investigates the language of propaganda and its stylistic features. It presents the PPN dataset, standing for Propagandist Pseudo-News, a multisource, multilingual, multimodal dataset composed of news articles extracted from websites identified as propaganda sources by expert agencies. A limited sample from this set was randomly mixed with papers from the regular French press, and their URL masked, to conduct an annotation-experiment by humans, using 11 distinct labels. The results show that human annotators were able to reliably discriminate between the two types of press across each of the labels. We propose different NLP techniques to identify the cues used by the annotators, and to compare them with machine classification. They include the analyzer VAGO to measure discourse vagueness and subjectivity, a TF-IDF to serve as a baseline, and four different classifiers: two RoBERTa-based models, CATS using syntax, and one XGBoost combining syntactic and semantic features.