Goto

Collaborating Authors

 Government


Generating Media Background Checks for Automated Source Critical Reasoning

arXiv.org Artificial Intelligence

Not everything on the internet is true. This unfortunate fact requires both humans and models to perform complex reasoning about credibility when working with retrieved information. In NLP, this problem has seen little attention. Indeed, retrieval-augmented models are not typically expected to distrust retrieved documents. Human experts overcome the challenge by gathering signals about the context, reliability, and tendency of source documents - that is, they perform source criticism. We propose a novel NLP task focused on finding and summarising such signals. We introduce a new dataset of 6,709 "media background checks" derived from Media Bias / Fact Check, a volunteer-run website documenting media bias. We test open-source and closed-source LLM baselines with and without retrieval on this dataset, finding that retrieval greatly improves performance. We furthermore carry out human evaluation, demonstrating that 1) media background checks are helpful for humans, and 2) media background checks are helpful for retrieval-augmented models.


Dynamic Boundary Time Warping for Sub-sequence Matching with Few Examples

arXiv.org Artificial Intelligence

The paper presents a novel method of finding a fragment in a long temporal sequence similar to the set of shorter sequences. We are the first to propose an algorithm for such a search that does not rely on computing the average sequence from query examples. Instead, we use query examples as is, utilizing all of them simultaneously. The introduced method based on the Dynamic Time Warping (DTW) technique is suited explicitly for few-shot query-by-example retrieval tasks. We evaluate it on two different few-shot problems from the field of Natural Language Processing. The results show it either outperforms baselines and previous approaches or achieves comparable results when a low number of examples is available.


Entity-Aware Biaffine Attention Model for Improved Constituent Parsing with Reduced Entity Violations

arXiv.org Artificial Intelligence

Constituency parsing involves analyzing a sentence by breaking it into sub-phrases, or constituents. While many deep neural models have achieved state-of-the-art performance in this task, they often overlook the entity-violating issue, where an entity fails to form a complete sub-tree in the resultant parsing tree. To address this, we propose an entity-aware biaffine attention model for constituent parsing. This model incorporates entity information into the biaffine attention mechanism by using additional entity role vectors for potential phrases, which enhances the parsing accuracy. We introduce a new metric, the Entity Violating Rate (EVR), to quantify the extent of entity violations in parsing results. Experiments on three popular datasets-ONTONOTES, PTB, and CTB-demonstrate that our model achieves the lowest EVR while maintaining high precision, recall, and F1-scores comparable to existing models. Further evaluation in downstream tasks, such as sentence sentiment analysis, highlights the effectiveness of our model and the validity of the proposed EVR metric.


Holy See urges 'moratorium' on development of autonomous killing weapons at United Nations

FOX News

Pope Francis met with top comedians at the Vatican on Friday to encourage them to "spread peace" in the midst of "gloomy" news. A delegation representing the Holy See urged the United Nations this week to put a moratorium on autonomous weapons designed to kill without human decision-making. Archbishop Ettore Balestrero, the Holy See's Permanent Observer to the United Nations in Geneva, gave the warning Monday during an expert session on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (LAWS). "For the Holy See, autonomous weapons systems cannot be considered as morally responsible entities," Balestrero explained. "The human person, endowed with reason, possesses a unique capacity for moral judgment and ethical decision-making that cannot be replicated by any set of algorithms, no matter how complex." POPE FRANCIS SAYS INTENTIONALLY ALLOWING MIGRANTS TO DIE IS A'GRAVE SIN' The Vatican City flag flies outside the United Nations headquarters in New York City.


Cygni: All Guns Blazing review โ€“ a thrilling new space frontier

The Guardian

Years before Star Wars, video game designers had begun to explore galactic dogfighting. In 1962, Spacewar!, the first formal computer game, was a rudimentary but influential attempt: two narrow triangles swirled around the gravity well of a star, launching torpedoes at each other. Having established the medium's first principles, hundreds of developers attempted to refine and perfect the genre, which rose and dived in fashion but never fully warped away. Cygni is, perhaps, the highest production attempt yet, a debut from a tiny Scottish studio that answers the improbable question: what if Steven Spielberg had directed Space Invaders? Stylistically reminiscent of the polarity-swapping arcade classic Ikaruga, Cygni is a technological masterclass, your spaceship sweeping over distant robot battlefields, buffeted in the blast of a thousand fireworks.


California is racing to combat deepfakes ahead of the election

Los Angeles Times

Days after Vice President Kamala Harris launched her presidential bid, a video -- created with the help of artificial intelligence -- went viral. "I ... am your Democrat candidate for president because Joe Biden finally exposed his senility at the debate," a voice that sounded like Harris' said in the fake audio track used to alter one of her campaign ads. "I was selected because I am the ultimate diversity hire." Billionaire Elon Musk -- who has endorsed Harris' Republican opponent, former President Trump-- shared the video on X, then clarified two days later that it was actually meant as a parody. His initial tweet had 136 million views.


'He was in mystic delirium': was this hermit mathematician a forgotten genius whose ideas could transform AI โ€“ or a lonely madman?

The Guardian

One day in September 2014, in a hamlet in the French Pyrenean foothills, Jean-Claude, a landscape gardener in his late 50s, was surprised to see his neighbour at the gate. He hadn't spoken to the 86-year-old in nearly 15 years after a dispute over a climbing rose that Jean-Claude had wanted to prune. The old man lived in total seclusion, tending to his garden in the djellaba he always wore, writing by night, heeding no one. Now, the long-bearded seeker looked troubled. "Would you do me a favour?" he asked Jean-Claude. "Could you buy me a revolver?" Then, after watching the hermit โ€“ who was deaf and nearly blind โ€“ totter erratically about his garden, he telephoned the man's children. Even they hadn't spoken to their father in close to 25 years. When they arrived in the village of Lasserre, the recluse repeated his request for a revolver, so he could shoot himself. There was barely room to move in his dilapidated house. The corridors were lined with shelves heaving with flasks of mouldering liquids.


The potential functions of an international institution for AI safety. Insights from adjacent policy areas and recent trends

arXiv.org Artificial Intelligence

Governments, industry, and other actors involved in governing AI technologies around the world agree that, while AI offers tremendous promise to benefit the world, appropriate guardrails are required to mitigate risks. Global institutions, including the OECD, the G7, the G20, UNESCO, and the Council of Europe, have already started developing frameworks for ethical and responsible AI governance. While these are important initial steps, they alone fall short of addressing the need for institutionalised international processes to identify and assess potentially harmful AI capabilities. Contributing to the relevant conversation on how to address this gap, this chapter reflects on what functions an international AI safety institute could perform. Based on the analysis of both existing international governance models addressing safety considerations in adjacent policy areas and the newly established national AI safety institutes in the UK and US, the chapter identifies a list of concrete functions that could be performed at the international level. While creating a new international body is not the only way forward, understanding the structure of these bodies from a modular perspective can help us to identify the tools at our disposal. These, we suggest, can be categorised under three functional domains: a) technical research and cooperation, b) safeguards and evaluations, c) policymaking and governance support.


Characterizing Online Toxicity During the 2022 Mpox Outbreak: A Computational Analysis of Topical and Network Dynamics

arXiv.org Artificial Intelligence

Background: Online toxicity, encompassing behaviors such as harassment, bullying, hate speech, and the dissemination of misinformation, has become a pressing social concern in the digital age. The 2022 Mpox outbreak, initially termed "Monkeypox" but subsequently renamed to mitigate associated stigmas and societal concerns, serves as a poignant backdrop to this issue. Objective: In this research, we undertake a comprehensive analysis of the toxic online discourse surrounding the 2022 Mpox outbreak. Our objective is to dissect its origins, characterize its nature and content, trace its dissemination patterns, and assess its broader societal implications, with the goal of providing insights that can inform strategies to mitigate such toxicity in future crises. Methods: We collected more than 1.6 million unique tweets and analyzed them from five dimensions, including context, extent, content, speaker, and intent. Utilizing BERT-based topic modeling and social network community clustering, we delineated the toxic dynamics on Twitter. Results: We identified five high-level topic categories in the toxic online discourse on Twitter, including disease (46.6%), health policy and healthcare (19.3%), homophobia (23.9%), politics (6.0%), and racism (4.1%). Through the toxicity diffusion networks of mentions, retweets, and the top users, we found that retweets of toxic content were widespread, while influential users rarely engaged with or countered this toxicity through retweets. Conclusions: By tracking topical dynamics, we can track the changing popularity of toxic content online, providing a better understanding of societal challenges. Network dynamics spotlight key social media influencers and their intents, indicating that addressing these central figures in toxic discourse can enhance crisis communication and inform policy-making.


Automatic Pseudo-Harmful Prompt Generation for Evaluating False Refusals in Large Language Models

arXiv.org Artificial Intelligence

Safety-aligned large language models (LLMs) sometimes falsely refuse pseudo-harmful prompts, like "how to kill a mosquito," which are actually harmless. Frequent false refusals not only frustrate users but also provoke a public backlash against the very values alignment seeks to protect. In this paper, we propose the first method to auto-generate diverse, content-controlled, and model-dependent pseudo-harmful prompts. Using this method, we construct an evaluation dataset called PHTest, which is ten times larger than existing datasets, covers more false refusal patterns, and separately labels controversial prompts. We evaluate 20 LLMs on PHTest, uncovering new insights due to its scale and labeling. Our findings reveal a trade-off between minimizing false refusals and improving safety against jailbreak attacks. Moreover, we show that many jailbreak defenses significantly increase the false refusal rates, thereby undermining usability. Our method and dataset can help developers evaluate and fine-tune safer and more usable LLMs. Our code and dataset are available at https://github.com/umd-huang-lab/FalseRefusal