Government
Tech experts warn lawmakers about bias in artificial intelligence systems
Artificial intelligence (AI) has transformed the way we live our everyday lives but tech experts this week warned member of Congress that the systems can have bias, which can lead to unintended consequences for millions of Americans. "AI is increasingly becoming a critical part of our daily lives," said Miriam Vogel, President and CEO of EqualAI. "We think each touch point is also an opportunity to identify and eliminate harmful biases." Bias in AI systems can be especially harmful in financial services. "For example, if you feed in data on who's gotten a mortgage in the past in the United States and ask the computer to make similar decisions in the future, you will get an AI that offers more mortgages to white people than people of color," said Meredith Broussard, an Associate Professor at New York University.
Call of Duty: Vanguard: Video game deploys diversity strategy for different WWII story
The upcoming video game "Call of Duty: Vanguard" transports you back to World War II โ but the latest entrant in the multibillion-selling franchises promises different perspectives of the global conflict. That diversity of perspectives is what you see deployed front and center in the main characters in the game, due out Nov. 5 for PlayStation 5, PS4, Xbox Series X/S, Xbox One, and PCs. Arthur Kingsley, who is Black and Russian sniper Lt. Polina Petrova, alongside squad mates Brooklyn-born pilot Wade Jackson, identified as a first-generation American, Australian explosives expert Lucas Riggs, and second-in-command Sgt. Richard Webb, who is white. This team โ a precursor to the modern Special Forces units โ is assembled for a mission to enter Berlin and thwart a German plan to establish a Fourth Reich.
China publishes code of ethics to regulate Artificial Intelligence, what would Isaac Asimov say?
China's Ministry of Science and Technology published a code of ethics that aims to regulate existing or developing Artificial Intelligence (AI) models. With this, the Asian country is ahead of Europe, which already had a prototype regulation in the same sense. Last April, the European Union presented the preliminary draft of a regulation to ensure that humans have control over AI. However, this has not materialized and now China is a pioneer in launching a regulation for these booming technologies. As reported by The South China Morning Post, the document entitled Ethical Specifications for New Generation Artificial Intelligence starts from a very clear premise: "Ensure that AI is always under the control of human beings" and that they have "full decision-making power " About AI. "Ultimately, China is opting for a heavy-handed model, where the state is thinking very seriously about the long-term social transformations that AI will bring, from social alienation to existential risks, and actively trying to manage and guide these transformations, "Rebecca Arcesati, analyst at the German think tank Mercator Institute for China Studies, told the same media.
Tree-based local explanations of machine learning model predictions, AraucanaXAI
Parimbelli, Enea, Nicora, Giovanna, Wilk, Szymon, Michalowski, Wojtek, Bellazzi, Riccardo
Increasingly complex learning methods such as boosting, bagging and deep learning have made ML models more accurate, but harder to understand and interpret. A tradeoff between between performance and intelligibility is often to be faced, especially in high-stakes applications like medicine. In the present article we propose a novel methodological approach for generating explanations of the predictions of a generic ML model, given a specific instance for which the prediction has been made, that can tackle both classification and regression tasks. Advantages of the proposed XAI approach include improved fidelity to the original model, ability to deal with non-linear decision boundaries, and native support to both classification and regression problems.
Surrogate- and invariance-boosted contrastive learning for data-scarce applications in science
Loh, Charlotte, Christensen, Thomas, Dangovski, Rumen, Kim, Samuel, Soljacic, Marin
Deep learning techniques have been increasingly applied to the natural sciences, e.g., for property prediction and optimization or material discovery. A fundamental ingredient of such approaches is the vast quantity of labelled data needed to train the model; this poses severe challenges in data-scarce settings where obtaining labels requires substantial computational or labor resources. Here, we introduce surrogate- and invariance-boosted contrastive learning (SIB-CL), a deep learning framework which incorporates three ``inexpensive'' and easily obtainable auxiliary information sources to overcome data scarcity. Specifically, these are: 1)~abundant unlabeled data, 2)~prior knowledge of symmetries or invariances and 3)~surrogate data obtained at near-zero cost. We demonstrate SIB-CL's effectiveness and generality on various scientific problems, e.g., predicting the density-of-states of 2D photonic crystals and solving the 3D time-independent Schrodinger equation. SIB-CL consistently results in orders of magnitude reduction in the number of labels needed to achieve the same network accuracies.
Control Prefixes for Text Generation
Clive, Jordan, Cao, Kris, Rei, Marek
Prompt learning methods adapt pre-trained language models to downstream applications by using a task-specific prompt together with the input. Most of the current work on prompt learning in text generation relies on a shared dataset-level prompt for all examples in the dataset. We extend this approach and propose a dynamic method, Control Prefixes, which allows for the inclusion of conditional input-dependent information in each prompt. Control Prefixes is at the intersection of prompt learning and controlled generation, empowering the model to have finer-grained control during text generation. The method incorporates attribute-level learnable representations into different layers of a pre-trained transformer, allowing for the generated text to be guided in a particular direction. We provide a systematic evaluation of the technique and apply it to five datasets from the GEM benchmark for natural language generation (NLG). We present state-of-the-art results on several data-to-text datasets, including WebNLG.
Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and Pipelining
Kaler, Tim, Stathas, Nickolas, Ouyang, Anne, Iliopoulos, Alexandros-Stavros, Schardl, Tao B., Leiserson, Charles E., Chen, Jie
Improving the training and inference performance of graph neural networks (GNNs) is faced with a challenge uncommon in general neural networks: creating mini-batches requires a lot of computation and data movement due to the exponential growth of multi-hop graph neighborhoods along network layers. Such a unique challenge gives rise to a diverse set of system design choices. We argue in favor of performing mini-batch training with neighborhood sampling in a distributed multi-GPU environment, under which we identify major performance bottlenecks hitherto under-explored by developers: mini-batch preparation and transfer. We present a sequence of improvements to mitigate these bottlenecks, including a performance-engineered neighborhood sampler, a shared-memory parallelization strategy, and the pipelining of batch transfer with GPU computation. We also conduct an empirical analysis that supports the use of sampling for inference, showing that test accuracies are not materially compromised. Such an observation unifies training and inference, simplifying model implementation. We report comprehensive experimental results with several benchmark data sets and GNN architectures, including a demonstration that, for the ogbn-papers100M data set, our system SALIENT achieves a speedup of 3x over a standard PyTorch-Geometric implementation with a single GPU and a further 8x parallel speedup with 16 GPUs. Therein, training a 3-layer GraphSAGE model with sampling fanout (15, 10, 5) takes 2.0 seconds per epoch and inference with fanout (20, 20, 20) takes 2.4 seconds, attaining test accuracy 64.58%.
When Combating Hype, Proceed with Caution
In an effort to avoid reinforcing widespread hype about the capabilities of state-of-the-art language technology, researchers have developed practices in framing and citation that serve to deemphasize the field's successes. Though well-meaning, these practices often yield misleading or even false claims about the limits of our best technology. This is a problem, and it may be more serious than it looks: It limits our ability to mitigate short-term harms from NLP deployments and it limits our ability to prepare for the potentially enormous impacts of more distant future advances. This paper urges researchers to be careful about these claims and suggests some research directions and communication strategies that will make it easier to avoid or rebut them.
Using DeepProbLog to perform Complex Event Processing on an Audio Stream
Vilamala, Marc Roig, Xing, Tianwei, Taylor, Harrison, Garcia, Luis, Srivastava, Mani, Kaplan, Lance, Preece, Alun, Kimmig, Angelika, Cerutti, Federico
In this paper, we present an approach to Complex Event Processing (CEP) that is based on DeepProbLog. This approach has the following objectives: (i) allowing the use of subsymbolic data as an input, (ii) retaining the flexibility and modularity on the definitions of complex event rules, (iii) allowing the system to be trained in an end-to-end manner and (iv) being robust against noisily labelled data. Our approach makes use of DeepProbLog to create a neuro-symbolic architecture that combines a neural network to process the subsymbolic data with a probabilistic logic layer to allow the user to define the rules for the complex events. We demonstrate that our approach is capable of detecting complex events from an audio stream. We also demonstrate that our approach is capable of training even with a dataset that has a moderate proportion of noisy data.
Improving Users' Mental Model with Attention-directed Counterfactual Edits
Alipour, Kamran, Ray, Arijit, Lin, Xiao, Cogswell, Michael, Schulze, Jurgen P., Yao, Yi, Burachas, Giedrius T.
In the domain of Visual Question Answering (VQA), studies have shown improvement in users' mental model of the VQA system when they are exposed to examples of how these systems answer certain Image-Question (IQ) pairs. In this work, we show that showing controlled counterfactual image-question examples are more effective at improving the mental model of users as compared to simply showing random examples. We compare a generative approach and a retrieval-based approach to show counterfactual examples. We use recent advances in generative adversarial networks (GANs) to generate counterfactual images by deleting and inpainting certain regions of interest in the image. We then expose users to changes in the VQA system's answer on those altered images. To select the region of interest for inpainting, we experiment with using both human-annotated attention maps and a fully automatic method that uses the VQA system's attention values. Finally, we test the user's mental model by asking them to predict the model's performance on a test counterfactual image. We note an overall improvement in users' accuracy to predict answer change when shown counterfactual explanations. While realistic retrieved counterfactuals obviously are the most effective at improving the mental model, we show that a generative approach can also be equally effective.