Africa
AI in Politics Is So Much Bigger Than Deepfakes
Last week, on the eve of the New Hampshire primary, some of the state's voters received a robocall purporting to be from President Joe Biden. Unlike the other such prerecorded calls reminding people to vote, this one had a different ask: Don't bother coming out to the polls, the voice instructed. Better to "save your vote for the November election." The message was strange, even nonsensical, but the voice on the line sure did sound like the president's. And caller ID showed that the call came from a former chair of the New Hampshire Democratic Party, according to the Associated Press.
Iran vows to 'decisively respond' to any US attacks: 'No threat will be left unanswered'
Iranian officials warned that Tehran would decisively respond to any U.S. attacks, as President Biden vowed unspecified action following the deaths of three American soldiers in Jordan. "We hear threats coming from American officials, we tell them that they have already tested us, and we now know one another, no threat will be left unanswered," Iranian Revolutionary Guards' chief Hossein Salami said on Wednesday, Reuters reported, citing the semi-official Tasnim news agency. "We are not after war, but we have no fear of war," Salami, who answers only to Supreme Leader Ayatollah Ali Khamenei, said at an event Wednesday, according to the state-run IRNA news agency. Another warning came from Amir Saeid Iravani, Iran's ambassador to the United Nations in New York. UNITED NATIONS SPOX INSISTS'UNRWA DOES NOT WORK WITH HAMAS' DESPITE CLAIMS EMPLOYEES PARTICIPATED IN OCT. 7 FILE - Iran's United Nations Ambassador Amir Saeid Iravani addresses the U.N. General Assembly at U.N. headquarters on Feb. 23, 2023.
Biden Says U.S. Response to Deadly Drone Strike in Jordan Has Been Decided
President Biden said on Tuesday that he had decided on a U.S. response to the drone attack on a remote outpost in Jordan on Sunday that killed three American soldiers and injured more than 40 others, leaving unstated what that decision was. Asked by reporters outside the White House whether he had decided on a response to the lethal attack, Mr. Biden said, "Yes" but declined to provide further details. John F. Kirby, a National Security Council spokesman, refused to elaborate on Mr. Biden's remarks other than to say it was "very possible" that the United States would carry out "a tiered approach" -- "not just a single action, but potentially multiple actions" over a period of time. Biden administration officials have blamed an explosives-laden drone, most likely launched by an Iran-backed militia in Iraq, for the attack -- the most deadly of the more than 160 militia attacks the Pentagon says U.S. forces have come under in the region since the start of the war between Israel and Hamas in Gaza nearly four months ago. Mr. Biden has vowed to retaliate and has met twice this week with his national security aides to discuss targets in Syria, Iraq and Iran.
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Soldaini, Luca, Kinney, Rodney, Bhagia, Akshita, Schwenk, Dustin, Atkinson, David, Authur, Russell, Bogin, Ben, Chandu, Khyathi, Dumas, Jennifer, Elazar, Yanai, Hofmann, Valentin, Jha, Ananya Harsh, Kumar, Sachin, Lucy, Li, Lyu, Xinxi, Lambert, Nathan, Magnusson, Ian, Morrison, Jacob, Muennighoff, Niklas, Naik, Aakanksha, Nam, Crystal, Peters, Matthew E., Ravichander, Abhilasha, Richardson, Kyle, Shen, Zejiang, Strubell, Emma, Subramani, Nishant, Tafjord, Oyvind, Walsh, Pete, Zettlemoyer, Luke, Smith, Noah A., Hajishirzi, Hannaneh, Beltagy, Iz, Groeneveld, Dirk, Dodge, Jesse, Lo, Kyle
Language models have become a critical technology to tackling a wide range of natural language processing tasks, yet many details about how the best-performing language models were developed are not reported. In particular, information about their pretraining corpora is seldom discussed: commercial language models rarely provide any information about their data; even open models rarely release datasets they are trained on, or an exact recipe to reproduce them. As a result, it is challenging to conduct certain threads of language modeling research, such as understanding how training data impacts model capabilities and shapes their limitations. To facilitate open research on language model pretraining, we release Dolma, a three trillion tokens English corpus, built from a diverse mixture of web content, scientific papers, code, public-domain books, social media, and encyclopedic materials. In addition, we open source our data curation toolkit to enable further experimentation and reproduction of our work. In this report, we document Dolma, including its design principles, details about its construction, and a summary of its contents. We interleave this report with analyses and experimental results from training language models on intermediate states of Dolma to share what we have learned about important data curation practices, including the role of content or quality filters, deduplication, and multi-source mixing. Dolma has been used to train OLMo, a state-of-the-art, open language model and framework designed to build and study the science of language modeling.
SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning
Luo, Jianlan, Hu, Zheyuan, Xu, Charles, Tan, You Liang, Berg, Jacob, Sharma, Archit, Schaal, Stefan, Finn, Chelsea, Gupta, Abhishek, Levine, Sergey
In recent years, significant progress has been made in the field of robotic reinforcement learning (RL), enabling methods that handle complex image observations, train in the real world, and incorporate auxiliary data, such as demonstrations and prior experience. However, despite these advances, robotic RL remains hard to use. It is acknowledged among practitioners that the particular implementation details of these algorithms are often just as important (if not more so) for performance as the choice of algorithm. We posit that a significant challenge to widespread adoption of robotic RL, as well as further development of robotic RL methods, is the comparative inaccessibility of such methods. To address this challenge, we developed a carefully implemented library containing a sample efficient off-policy deep RL method, together with methods for computing rewards and resetting the environment, a high-quality controller for a widely-adopted robot, and a number of challenging example tasks. We provide this library as a resource for the community, describe its design choices, and present experimental results. Perhaps surprisingly, we find that our implementation can achieve very efficient learning, acquiring policies for PCB board assembly, cable routing, and object relocation between 25 to 50 minutes of training per policy on average, improving over state-of-the-art results reported for similar tasks in the literature. These policies achieve perfect or near-perfect success rates, extreme robustness even under perturbations, and exhibit emergent recovery and correction behaviors. We hope that these promising results and our high-quality open-source implementation will provide a tool for the robotics community to facilitate further developments in robotic RL. Our code, documentation, and videos can be found at https://serl-robot.github.io/
LLMs Simulate Big Five Personality Traits: Further Evidence
Sorokovikova, Aleksandra, Fedorova, Natalia, Rezagholi, Sharwin, Yamshchikov, Ivan P.
An empirical investigation into the simulation of the Big Five personality traits by large language models (LLMs), namely Llama2, GPT4, and Mixtral, is presented. We analyze the personality traits simulated by these models and their stability. This contributes to the broader understanding of the capabilities of LLMs to simulate personality traits and the respective implications for personalized human-computer interaction.
Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective
Ma, Qun, Xue, Xiao, Zhou, Deyu, Yu, Xiangning, Liu, Donghua, Zhang, Xuwen, Zhao, Zihan, Shen, Yifan, Ji, Peilin, Li, Juanjuan, Wang, Gang, Ma, Wanpeng
Computational experiments have emerged as a valuable method for studying complex systems, involving the algorithmization of counterfactuals. However, accurately representing real social systems in Agent-based Modeling (ABM) is challenging due to the diverse and intricate characteristics of humans, including bounded rationality and heterogeneity. To address this limitation, the integration of Large Language Models (LLMs) has been proposed, enabling agents to possess anthropomorphic abilities such as complex reasoning and autonomous learning. These agents, known as LLM-based Agent, offer the potential to enhance the anthropomorphism lacking in ABM. Nonetheless, the absence of explicit explainability in LLMs significantly hinders their application in the social sciences. Conversely, computational experiments excel in providing causal analysis of individual behaviors and complex phenomena. Thus, combining computational experiments with LLM-based Agent holds substantial research potential. This paper aims to present a comprehensive exploration of this fusion. Primarily, it outlines the historical development of agent structures and their evolution into artificial societies, emphasizing their importance in computational experiments. Then it elucidates the advantages that computational experiments and LLM-based Agents offer each other, considering the perspectives of LLM-based Agent for computational experiments and vice versa. Finally, this paper addresses the challenges and future trends in this research domain, offering guidance for subsequent related studies.
ChIRAAG: ChatGPT Informed Rapid and Automated Assertion Generation
Mali, Bhabesh, Maddala, Karthik, Reddy, Sweeya, Gupta, Vatsal, Karfa, Chandan, Karri, Ramesh
System Verilog Assertion (SVA) formulation, a critical yet complex task, is a pre-requisite in the Formal Property Verification (FPV) process. Traditionally, SVA formulation involves expert-driven interpretation of specifications. This is time consuming and prone to human error. However, recent advances in Large Language Models (LLM), LLM-informed automatic assertion generation is gaining interest. We designed a novel LLM-based pipeline to generate assertions in English Language, Linear Temporal Logic, and SVA from natural language specifications. We developed a custom LLM-based on OpenAI GPT4 for our experiments. Furthermore, we developed testbenches to verify/validate the LLM-generated assertions. Only 43% of LLM-generated raw assertions had errors, including syntax and logical errors. By iteratively prompting the LLMs using carefully crafted prompts derived from test case failures, the pipeline could generate correct SVAs after a maximum of nine iterations of prompting. Our results show that LLMs can streamline the assertion generation workflow, reshaping verification workflows.
Nash Soft Actor-Critic LEO Satellite Handover Management Algorithm for Flying Vehicles
Chen, Jinxuan, Ozger, Mustafa, Cavdar, Cicek
Compared with the terrestrial networks (TN), which can only support limited coverage areas, low-earth orbit (LEO) satellites can provide seamless global coverage and high survivability in case of emergencies. Nevertheless, the swift movement of the LEO satellites poses a challenge: frequent handovers are inevitable, compromising the quality of service (QoS) of users and leading to discontinuous connectivity. Moreover, considering LEO satellite connectivity for different flying vehicles (FVs) when coexisting with ground terminals, an efficient satellite handover decision control and mobility management strategy is required to reduce the number of handovers and allocate resources that align with different users' requirements. In this paper, a novel distributed satellite handover strategy based on Multi-Agent Reinforcement Learning (MARL) and game theory named Nash-SAC has been proposed to solve these problems. From the simulation results, the Nash-SAC-based handover strategy can effectively reduce the handovers by over 16 percent and the blocking rate by over 18 percent, outperforming local benchmarks such as traditional Q-learning. It also greatly improves the network utility used to quantify the performance of the whole system by up to 48 percent and caters to different users requirements, providing reliable and robust connectivity for both FVs and ground terminals.
Modeling Access Differences to Reduce Disparity in Resource Allocation
Andrews, Kenya, Ohannessian, Mesrob, Berger-Wolf, Tanya
Motivated by COVID-19 vaccine allocation, where vulnerable subpopulations are simultaneously more impacted in terms of health and more disadvantaged in terms of access to the vaccine, we formalize and study the problem of resource allocation when there are inherent access differences that correlate with advantage and disadvantage. We identify reducing resource disparity as a key goal in this context and show its role as a proxy to more nuanced downstream impacts. We develop a concrete access model that helps quantify how a given allocation translates to resource flow for the advantaged vs. the disadvantaged, based on the access gap between them. We then provide a methodology for access-aware allocation. Intuitively, the resulting allocation leverages more vaccines in locations with higher vulnerable populations to mitigate the access gap and reduce overall disparity. Surprisingly, knowledge of the access gap is often not needed to perform access-aware allocation. To support this formalism, we provide empirical evidence for our access model and show that access-aware allocation can significantly reduce resource disparity and thus improve downstream outcomes. We demonstrate this at various scales, including at county, state, national, and global levels.