Goto

Collaborating Authors

 Government


Agent-Enhanced Large Language Models for Researching Political Institutions

arXiv.org Artificial Intelligence

The applications of Large Language Models (LLMs) in political science are rapidly expanding. This paper demonstrates how LLMs, when augmented with predefined functions and specialized tools, can serve as dynamic agents capable of streamlining tasks such as data collection, preprocessing, and analysis. Central to this approach is agentic retrieval-augmented generation (Agentic RAG), which equips LLMs with action-calling capabilities for interaction with external knowledge bases. Beyond information retrieval, LLM agents may incorporate modular tools for tasks like document summarization, transcript coding, qualitative variable classification, and statistical modeling. To demonstrate the potential of this approach, we introduce CongressRA, an LLM agent designed to support scholars studying the U.S. Congress. Through this example, we highlight how LLM agents can reduce the costs of replicating, testing, and extending empirical research using the domain-specific data that drives the study of political institutions.


PUBLICSPEAK: Hearing the Public with a Probabilistic Framework in Local Government

arXiv.org Artificial Intelligence

Local governments around the world are making consequential decisions on behalf of their constituents, and these constituents are responding with requests, advice, and assessments of their officials at public meetings. So many small meetings cannot be covered by traditional newsrooms at scale. We propose PUBLICSPEAK, a probabilistic framework which can utilize meeting structure, domain knowledge, and linguistic information to discover public remarks in local government meetings. We then use our approach to inspect the issues raised by constituents in 7 cities across the United States. We evaluate our approach on a novel dataset of local government meetings and find that PUBLICSPEAK improves over state-of-the-art by 10% on average, and by up to 40%.


Align in Depth: Defending Jailbreak Attacks via Progressive Answer Detoxification

arXiv.org Artificial Intelligence

Large Language Models (LLMs) are vulnerable to jailbreak attacks, which use crafted prompts to elicit toxic responses. These attacks exploit LLMs' difficulty in dynamically detecting harmful intents during the generation process. Traditional safety alignment methods, often relying on the initial few generation steps, are ineffective due to limited computational budget. This paper proposes DEEPALIGN, a robust defense framework that fine-tunes LLMs to progressively detoxify generated content, significantly improving both the computational budget and effectiveness of mitigating harmful generation. Our approach uses a hybrid loss function operating on hidden states to directly improve LLMs' inherent awareness of toxity during generation. Furthermore, we redefine safe responses by generating semantically relevant answers to harmful queries, thereby increasing robustness against representation-mutation attacks. Evaluations across multiple LLMs demonstrate state-of-the-art defense performance against six different attack types, reducing Attack Success Rates by up to two orders of magnitude compared to previous state-of-the-art defense while preserving utility. This work advances LLM safety by addressing limitations of conventional alignment through dynamic, context-aware mitigation.


Poisoned-MRAG: Knowledge Poisoning Attacks to Multimodal Retrieval Augmented Generation

arXiv.org Artificial Intelligence

Multimodal retrieval-augmented generation (RAG) enhances the visual reasoning capability of vision-language models (VLMs) by dynamically accessing information from external knowledge bases. In this work, we introduce \textit{Poisoned-MRAG}, the first knowledge poisoning attack on multimodal RAG systems. Poisoned-MRAG injects a few carefully crafted image-text pairs into the multimodal knowledge database, manipulating VLMs to generate the attacker-desired response to a target query. Specifically, we formalize the attack as an optimization problem and propose two cross-modal attack strategies, dirty-label and clean-label, tailored to the attacker's knowledge and goals. Our extensive experiments across multiple knowledge databases and VLMs show that Poisoned-MRAG outperforms existing methods, achieving up to 98\% attack success rate with just five malicious image-text pairs injected into the InfoSeek database (481,782 pairs). Additionally, We evaluate 4 different defense strategies, including paraphrasing, duplicate removal, structure-driven mitigation, and purification, demonstrating their limited effectiveness and trade-offs against Poisoned-MRAG. Our results highlight the effectiveness and scalability of Poisoned-MRAG, underscoring its potential as a significant threat to multimodal RAG systems.


Do Not Trust Licenses You See: Dataset Compliance Requires Massive-Scale AI-Powered Lifecycle Tracing

arXiv.org Artificial Intelligence

This paper argues that a dataset's legal risk cannot be accurately assessed by its license terms alone; instead, tracking dataset redistribution and its full lifecycle is essential. However, this process is too complex for legal experts to handle manually at scale. Tracking dataset provenance, verifying redistribution rights, and assessing evolving legal risks across multiple stages require a level of precision and efficiency that exceeds human capabilities. Addressing this challenge effectively demands AI agents that can systematically trace dataset redistribution, analyze compliance, and identify legal risks. We develop an automated data compliance system called NEXUS and show that AI can perform these tasks with higher accuracy, efficiency, and cost-effectiveness than human experts. Our massive legal analysis of 17,429 unique entities and 8,072 license terms using this approach reveals the discrepancies in legal rights between the original datasets before redistribution and their redistributed subsets, underscoring the necessity of the data lifecycle-aware compliance. For instance, we find that out of 2,852 datasets with commercially viable individual license terms, only 605 (21%) are legally permissible for commercialization. This work sets a new standard for AI data governance, advocating for a framework that systematically examines the entire lifecycle of dataset redistribution to ensure transparent, legal, and responsible dataset management.


Release of technology secretary's use of ChatGPT will have Whitehall sweating

The Guardian

When Tony Blair looked back on his time in power, he had a simple assessment of his decision to introduce the Freedom of Information Act: "You idiot." While the technology secretary, Peter Kyle, is a fan of the former prime minister, he may be inclined to agree with that verdict after the act was used to reveal that he had been asking ChatGPT which podcasts he should appear on. The disclosure has already caused frustration among ministers, given its possible repercussions. Blair's gripe was that the act risked stopping the frank discussions needed among ministers and officials. Ever since, it has become notoriously difficult to have a freedom of information (FoI) request granted, as officials exploit various legal exemptions to refuse them. The successful use of the legislation to probe into Kyle's AI chatbot use has led some to conclude that a new precedent has been set, one that will have officials across Whitehall sweating over their recent chatbot interactions.


Elon Musk wants to use AI to run US gov't, but experts say 'very bad' idea

Al Jazeera

Is Elon Musk planning to use artificial intelligence to run the US government? That seems to be his plan, but experts say it is a "very bad idea". Musk has fired tens of thousands of federal government employees through his Department of Government Efficiency (DOGE), and he reportedly requires the remaining workers to send the department a weekly email featuring five bullet points describing what they accomplished that week. Since that will no doubt flood DOGE with hundreds of thousands of these types of emails, Musk is relying on artificial intelligence to process responses and help determine who should remain employed. Part of that plan reportedly is also to replace many government workers with AI systems.


The FCC is creating a new Council for National Security within the agency

Engadget

The Federal Communications Commission (FCC) said on Thursday it's creating a new Council for National Security within the agency. The FCC's announcement doesn't go into much detail about what the group will do, but a list of its broader goals focuses on US competition with China, including in AI and other tech sectors. The FCC's statement on the Council for National Security says its three-part agenda includes: "Ensure the US wins the strategic competition with China over critical technologies, such as 5G and 6G, AI, satellites and space, quantum computing, robotics and autonomous systems, and the Internet of Things" Although the statement mentions foreign adversaries several times, it only calls out China specifically. The Council will include representatives from eight Bureaus and Offices within the FCC, an arrangement the agency says will foster cross-agency collaboration and information sharing. Adam Chan, who serves as the FCC's security counsel, as the director of the Council on National Security.


Revealed: How the UK tech secretary uses ChatGPT for policy advice

New Scientist

Peter Kyle, the UK's secretary of state for science, innovation and technology, has said he uses ChatGPT to understand difficult concepts The UK's technology secretary, Peter Kyle, has asked ChatGPT for advice on why the adoption of artificial intelligence is so slow in the UK business community โ€“ and which podcasts he should appear on. This week, Prime Minister Keir Starmer said that the UK government should be making far more use of AI in an effort to increase efficiency. "No person's substantive time should be spent on a task where digital or AI can do it better, quicker and to the same high quality and standard," he said. Now, New Scientist has obtained records of Kyle's ChatGPT use under the Freedom of Information (FOI) Act, in what is believed to be a world-first test of whether chatbot interactions are subject to such laws. These records show that Kyle asked ChatGPT to explain why the UK's small and medium business (SMB) community has been so slow to adopt AI.


Securing the AI future: How President Trump's action plan can position America for success

FOX News

The Trump administration is prioritizing the critical role of artificial intelligence in creating and upholding freedom. Just three weeks in, Vice President JD Vance declared at a global AI summit in Paris that AI "will make people more productive, more prosperous, and more free. The United States of America is the leader in AI, and our administration plans to keep it that way." To achieve this, the White House is working toward an AI action plan and calling on leading American AI companies to submit our best ideas. OpenAI is pleased to submit proposals today on a range of important considerations for AI from national security, to infrastructure and energy, to the federal government's own use of AI.