Government
Army, University of Maryland Enter Cooperative Artificial Intelligence Partnership
U.S. military and academic researchers are set to explore emerging artificial intelligence applications and form a shared hub to advance how intelligent machines operate with one another and humans across multiple domains. Those efforts and others to develop autonomous air- and ground-based technologies will unfold under a new five-year cooperative agreement between the Army Research Laboratory and University of Maryland. "ARL is always interested in engaging with academic institutions to address unique Army challenges," Karl Kappra, director of ARL's Futures Division, told Nextgov in an email. Interdisciplinary research teams of faculty, staff and students from UMD's College Park and Baltimore County campuses will work directly with 18 initial projects to start. Their pursuits will encompass three main research thrusts--AI, autonomy, and modeling and simulation--the university confirmed in a press release.
Chinese AI lab challenges Google, OpenAI with a model of 1.75 trillion parameters- PingWest
In the race to build the underlying technologies that can power the next wave of AI revolution, a Chinese lab just toppled OpenAI, the venerated US-based research lab, in terms of who can train a gigantic deep learning model with the most training parameters--as for whether or not there is a race, at least ranking members of the lab believe so. The Beijing Academy of Artificial Intelligence, styled as BAAI and known in Chinese as 北京智源人工智能研究院, launched the latest version of Wudao 悟道, a pre-trained deep learning model that the lab dubbed as "China's first," and "the world's largest ever," with a whopping 1.75 trillion parameters. Unlike conventional deep learning models that are usually task-specific, Wudao is a multi-modal model trained to tackle both text and image, two dramatically different sets of problems. At BAAI's annual academic conference on Tuesday, the institution demonstrated Wudao performing tasks such as natural language processing, text generation, image recognition, image generation, etc. The model is capable of writing poems and couplets in the traditional Chinese styles, answer questions, write essays, generate alt text for images, and generate corresponding images from natural language description with a decent level of photorealism. It is even able to power "virtual idols", with the help of XiaoIce, a Chinese company spun off of Microsoft--so there can be voice support too, in addition to text and image.
Military Applications Of AI Around The World
The Israel Defense Forces' (IDF) operation against Hamas is called the world's first artificial intelligence (AI) war. Register for AWS ML Fridays and learn how to make a career in data science. "For the first time, artificial intelligence was a key component and power multiplier in fighting the enemy," an IDF Intelligence Corps senior officer said. He said this is a first-of-its-kind campaign for the IDF. In 2020, an Iranian nuclear scientist was killed using a satellite controlled weapon.
Addressing the Long-term Impact of ML Decisions via Policy Regret
Lindner, David, Heidari, Hoda, Krause, Andreas
Machine Learning (ML) increasingly informs the allocation of opportunities to individuals and communities in areas such as lending, education, employment, and beyond. Such decisions often impact their subjects' future characteristics and capabilities in an a priori unknown fashion. The decision-maker, therefore, faces exploration-exploitation dilemmas akin to those in multi-armed bandits. Following prior work, we model communities as arms. To capture the long-term effects of ML-based allocation decisions, we study a setting in which the reward from each arm evolves every time the decision-maker pulls that arm. We focus on reward functions that are initially increasing in the number of pulls but may become (and remain) decreasing after a certain point. We argue that an acceptable sequential allocation of opportunities must take an arm's potential for growth into account. We capture these considerations through the notion of policy regret, a much stronger notion than the often-studied external regret, and present an algorithm with provably sub-linear policy regret for sufficiently long time horizons. We empirically compare our algorithm with several baselines and find that it consistently outperforms them, in particular for long time horizons.
A Cognitive Science perspective for learning how to design meaningful user experiences and human-centered technology
Misinterpreted or misleading in cognitive science, human-computer interaction (HCI) and stories or facts are known to "go viral" and to increase the natural-language processing (NLP) to consider how analogical likelihood for incivility [11]. Referred to as "misinformation" reasoning (AR) could help inform the design of communication or "disinformation," the phenomenon is, in part, a product of and learning technologies, as well as online communities (exploiting) analogical reasoning and normal cognitive processes and digital platforms. First, analogical reasoning (AR) is [3, 19]. Problematically, digital platforms are efficient defined, and use-cases of AR in the computing sciences are mechanisms for spreading rumors, participating in misinterpretations, presented. The concept of schema is introduced, along with and for misconstruing fact-sharing as opinion [16].
Towards an Explanation Space to Align Humans and Explainable-AI Teamwork
Cabour, Garrick, Morales, Andrés, Ledoux, Élise, Bassetto, Samuel
Providing meaningful and actionable explanations to end-users is a fundamental prerequisite for implementing explainable intelligent systems in the real world. Explainability is a situated interaction between a user and the AI system rather than being static design principles. The content of explanations is context-dependent and must be defined by evidence about the user and its context. This paper seeks to operationalize this concept by proposing a formative architecture that defines the explanation space from a user-inspired perspective. The architecture comprises five intertwined components to outline explanation requirements for a task: (1) the end-users mental models, (2) the end-users cognitive process, (3) the user interface, (4) the human-explainer agent, and the (5) agent process. We first define each component of the architecture. Then we present the Abstracted Explanation Space, a modeling tool that aggregates the architecture's components to support designers in systematically aligning explanations with the end-users work practices, needs, and goals. It guides the specifications of what needs to be explained (content - end-users mental model), why this explanation is necessary (context - end-users cognitive process), to delimit how to explain it (format - human-explainer agent and user interface), and when should the explanations be given. We then exemplify the tool's use in an ongoing case study in the aircraft maintenance domain. Finally, we discuss possible contributions of the tool, known limitations/areas for improvement, and future work to be done.
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Jiang, Yichen, Celikyilmaz, Asli, Smolensky, Paul, Soulos, Paul, Rao, Sudha, Palangi, Hamid, Fernandez, Roland, Smith, Caitlin, Bansal, Mohit, Gao, Jianfeng
Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, and (2) composing a cohesive text by reconstructing these salient facts into a shorter summary that faithfully reflects the complex relations connecting these facts. In this paper, we adapt TP-TRANSFORMER (Schlag et al., 2019), an architecture that enriches the original Transformer (Vaswani et al., 2017) with the explicitly compositional Tensor Product Representation (TPR), for the task of abstractive summarization. The key feature of our model is a structural bias that we introduce by encoding two separate representations for each token to represent the syntactic structure (with role vectors) and semantic content (with filler vectors) separately. The model then binds the role and filler vectors into the TPR as the layer output. We argue that the structured intermediate representations enable the model to take better control of the contents (salient facts) and structures (the syntax that connects the facts) when generating the summary. Empirically, we show that our TP-TRANSFORMER outperforms the Transformer and the original TP-TRANSFORMER significantly on several abstractive summarization datasets based on both automatic and human evaluations. On several syntactic and semantic probing tasks, we demonstrate the emergent structural information in the role vectors and improved syntactic interpretability in the TPR layer outputs. Code and models are available at https://github.com/jiangycTarheel/TPT-Summ.
Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification
Si, Jiasheng, Zhou, Deyu, Li, Tongzhe, Shi, Xingyu, He, Yulan
Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore the semantic interaction between the claim and evidence at different granularity levels but fail to capture their topical consistency during the reasoning process, which we believe is crucial for verification; (ii) aggregate multiple pieces of evidence equally without considering their implicit stances to the claim, thereby introducing spurious information. To alleviate the above issues, we propose a novel topic-aware evidence reasoning and stance-aware aggregation model for more accurate fact verification, with the following four key properties: 1) checking topical consistency between the claim and evidence; 2) maintaining topical coherence among multiple pieces of evidence; 3) ensuring semantic similarity between the global topic information and the semantic representation of evidence; 4) aggregating evidence based on their implicit stances to the claim. Extensive experiments conducted on the two benchmark datasets demonstrate the superiority of the proposed model over several state-of-the-art approaches for fact verification. The source code can be obtained from https://github.com/jasenchn/TARSA.
SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialogues
Qiu, Liang, Liang, Yuan, Zhao, Yizhou, Lu, Pan, Peng, Baolin, Yu, Zhou, Wu, Ying Nian, Zhu, Song-Chun
Inferring social relations from dialogues is vital for building emotionally intelligent robots to interpret human language better and act accordingly. We model the social network as an And-or Graph, named SocAoG, for the consistency of relations among a group and leveraging attributes as inference cues. Moreover, we formulate a sequential structure prediction task, and propose an $\alpha$-$\beta$-$\gamma$ strategy to incrementally parse SocAoG for the dynamic inference upon any incoming utterance: (i) an $\alpha$ process predicting attributes and relations conditioned on the semantics of dialogues, (ii) a $\beta$ process updating the social relations based on related attributes, and (iii) a $\gamma$ process updating individual's attributes based on interpersonal social relations. Empirical results on DialogRE and MovieGraph show that our model infers social relations more accurately than the state-of-the-art methods. Moreover, the ablation study shows the three processes complement each other, and the case study demonstrates the dynamic relational inference.
Conversational Question Answering: A Survey
Zaib, Munazza, Zhang, Wei Emma, Sheng, Quan Z., Mahmood, Adnan, Zhang, Yang
Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of conversational artificial intelligence (AI) which has led to the introduction of a special research topic on Conversational Question Answering (CQA), wherein a system is required to understand the given context and then engages in multi-turn QA to satisfy the user's information needs. Whilst the focus of most of the existing research work is subjected to single-turn QA, the field of multi-turn QA has recently grasped attention and prominence owing to the availability of large-scale, multi-turn QA datasets and the development of pre-trained language models. With a good amount of models and research papers adding to the literature every year recently, there is a dire need of arranging and presenting the related work in a unified manner to streamline future research. This survey, therefore, is an effort to present a comprehensive review of the state-of-the-art research trends of CQA primarily based on reviewed papers from 2016-2021. Our findings show that there has been a trend shift from single-turn to multi-turn QA which empowers the field of Conversational AI from different perspectives. This survey is intended to provide an epitome for the research community with the hope of laying a strong foundation for the field of CQA.