Goto

Collaborating Authors

 Government


Grounded Keys-to-Text Generation: Towards Factual Open-Ended Generation

arXiv.org Artificial Intelligence

Large pre-trained language models have recently enabled open-ended generation frameworks (e.g., prompt-to-text NLG) to tackle a variety of tasks going beyond the traditional data-to-text generation. While this framework is more general, it is under-specified and often leads to a lack of controllability restricting their real-world usage. We propose a new grounded keys-to-text generation task: the task is to generate a factual description about an entity given a set of guiding keys, and grounding passages. To address this task, we introduce a new dataset, called EntDeGen. Inspired by recent QA-based evaluation measures, we propose an automatic metric, MAFE, for factual correctness of generated descriptions. Our EntDescriptor model is equipped with strong rankers to fetch helpful passages and generate entity descriptions. Experimental result shows a good correlation (60.14) between our proposed metric and human judgments of factuality. Our rankers significantly improved the factual correctness of generated descriptions (15.95% and 34.51% relative gains in recall and precision). Finally, our ablation study highlights the benefit of combining keys and groundings.


Ballot Length in Instant Runoff Voting

arXiv.org Artificial Intelligence

Instant runoff voting (IRV) is an increasingly-popular alternative to traditional plurality voting in which voters submit rankings over the candidates rather than single votes. In practice, elections using IRV often restrict the ballot length, the number of candidates a voter is allowed to rank on their ballot. We theoretically and empirically analyze how ballot length can influence the outcome of an election, given fixed voter preferences. We show that there exist preference profiles over $k$ candidates such that up to $k-1$ different candidates win at different ballot lengths. We derive exact lower bounds on the number of voters required for such profiles and provide a construction matching the lower bound for unrestricted voter preferences. Additionally, we characterize which sequences of winners are possible over ballot lengths and provide explicit profile constructions achieving any feasible winner sequence. We also examine how classic preference restrictions influence our results--for instance, single-peakedness makes $k-1$ different winners impossible but still allows at least $\Omega(\sqrt k)$. Finally, we analyze a collection of 168 real-world elections, where we truncate rankings to simulate shorter ballots. We find that shorter ballots could have changed the outcome in one quarter of these elections. Our results highlight ballot length as a consequential degree of freedom in the design of IRV elections.


Experts Believe the World is Nearing its End! Killer Robots will Dominate Us

#artificialintelligence

Weapon systems that select and engage targets without meaningful human control are unacceptable and need to be prevented. All countries have a duty to protect humanity from this dangerous development by banning fully autonomous weapons. Retaining meaningful human control over the use of force is an ethical imperative, a legal necessity, and a moral obligation. In the period since Human Rights Watch and other nongovernmental organizations launched the Campaign to Stop Killer Robots in 2013, the question of how to respond to concerns over fully autonomous weapons has steadily climbed the international agenda. The challenge of killer robots, like climate change, is widely regarded as a grave threat to humanity that deserves urgent multilateral action.


Artificial Intelligence: What is it and why do we need to regulate it? Know all details here

#artificialintelligence

Today, billions of people use Artificial Intelligence at some level globally. This also alarms governments and humans regarding the unprecedented impacts of AI, machine learning, and big data on civilisation.


Topical Segmentation of Spoken Narratives: A Test Case on Holocaust Survivor Testimonies

arXiv.org Artificial Intelligence

The task of topical segmentation is well studied, but previous work has mostly addressed it in the context of structured, well-defined segments, such as segmentation into paragraphs, chapters, or segmenting text that originated from multiple sources. We tackle the task of segmenting running (spoken) narratives, which poses hitherto unaddressed challenges. As a test case, we address Holocaust survivor testimonies, given in English. Other than the importance of studying these testimonies for Holocaust research, we argue that they provide an interesting test case for topical segmentation, due to their unstructured surface level, relative abundance (tens of thousands of such testimonies were collected), and the relatively confined domain that they cover. We hypothesize that boundary points between segments correspond to low mutual information between the sentences proceeding and following the boundary. Based on this hypothesis, we explore a range of algorithmic approaches to the task, building on previous work on segmentation that uses generative Bayesian modeling and state-of-the-art neural machinery. Compared to manually annotated references, we find that the developed approaches show considerable improvements over previous work.


Fairness in Contextual Resource Allocation Systems: Metrics and Incompatibility Results

arXiv.org Artificial Intelligence

We study critical systems that allocate scarce resources to satisfy basic needs, such as homeless services that provide housing. These systems often support communities disproportionately affected by systemic racial, gender, or other injustices, so it is crucial to design these systems with fairness considerations in mind. To address this problem, we propose a framework for evaluating fairness in contextual resource allocation systems that is inspired by fairness metrics in machine learning. This framework can be applied to evaluate the fairness properties of a historical policy, as well as to impose constraints in the design of new (counterfactual) allocation policies. Our work culminates with a set of incompatibility results that investigate the interplay between the different fairness metrics we propose. Notably, we demonstrate that: 1) fairness in allocation and fairness in outcomes are usually incompatible; 2) policies that prioritize based on a vulnerability score will usually result in unequal outcomes across groups, even if the score is perfectly calibrated; 3) policies using contextual information beyond what is needed to characterize baseline risk and treatment effects can be fairer in their outcomes than those using just baseline risk and treatment effects; and 4) policies using group status in addition to baseline risk and treatment effects are as fair as possible given all available information. Our framework can help guide the discussion among stakeholders in deciding which fairness metrics to impose when allocating scarce resources.


A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges

arXiv.org Artificial Intelligence

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises the reliability of a model. The problem has gained significant attention due to its importance for safety deploying models in open-world settings. Detecting OOD samples is challenging due to the intractability of modeling all possible unknown distributions. To date, several research domains tackle the problem of detecting unfamiliar samples, including anomaly detection, novelty detection, one-class learning, open set recognition, and out-of-distribution detection. Despite having similar and shared concepts, out-of-distribution, open-set, and anomaly detection have been investigated independently. Accordingly, these research avenues have not cross-pollinated, creating research barriers. While some surveys intend to provide an overview of these approaches, they seem to only focus on a specific domain without examining the relationship between different domains. This survey aims to provide a cross-domain and comprehensive review of numerous eminent works in respective areas while identifying their commonalities. Researchers can benefit from the overview of research advances in different fields and develop future methodology synergistically. Furthermore, to the best of our knowledge, while there are surveys in anomaly detection or one-class learning, there is no comprehensive or up-to-date survey on out-of-distribution detection, which our survey covers extensively. Finally, having a unified cross-domain perspective, we discuss and shed light on future lines of research, intending to bring these fields closer together.


5 ethical AI considerations to future proof your business

#artificialintelligence

With greater scrutiny of tech practices and calls for transparency, businesses must manage the deployment of smart AI while ensuring privacy safeguards, preventing bias in algorithmic decision-making, and meeting guidelines in highly regulated industries. In this article, I look at five ways leaders can future-proof their businesses against these risks. Regulating AI is a multifaceted and difficult challenge, and as a result, the regulatory landscape is a consistently evolving environment. However, the issue of unethical and biased AI is becoming critical as organizations are increasingly relying on algorithms to support their decisions – and we will undoubtedly see the ramp-up of regulatory scrutiny in the coming years as a result. To avoid the consequences of financial and reputational damage from unethical AI, organizations will need to get ahead of the curve.


As 'Halo Infinite' esports enters year 2, teams express cautious optimism

Washington Post - Technology News

"Viewership is absolutely critical to the success of this ecosystem," wrote Tahir "Tashi" Hasandjekic, head of esports at 343 Industries, the subsidiary of Microsoft that developed "Infinite," in a blog post Jan. 2022. At the time, the HCS was riding high on the popularity of its debut tournament, and the competitive scene was a bright spot in an otherwise dimming constellation. Some of the biggest esports teams in the world, like OpTic Gaming and FaZe Clan, had eagerly joined up for "Halo Infinite," signing veteran stars and top emerging talent. At peak vewiership, more than 267,000 Halo fans were tuned into the game's first major tournament concurrently.


Finally, an A.I. Chatbot That Reliably Passes "the Nazi Test"

Slate

This article is from Big Technology, a newsletter by Alex Kantrowitz. A chatbot that meets the hype is finally here. On Thursday, OpenAI released ChatGPT, a bot that converses with humans via cutting-edge artificial intelligence. The bot can help you write code, compose essays, dream up stories, and decorate your living room. And that's just what people discovered on day one.