QA models with lifelong learning (LL) abilities are important for practical QA applications, and architecture-based LL methods are reported to be an effective implementation for these models. However, it is non-trivial to extend previous approaches to QA tasks since they either require access to task identities in the testing phase or do not explicitly model samples from unseen tasks. In this paper, we propose Diana: a dynamic architecture-based lifelong QA model that tries to learn a sequence of QA tasks with a prompt enhanced language model. Four types of hierarchically organized prompts are used in Diana to capture QA knowledge from different granularities. Specifically, we dedicate task-level prompts to capture task-specific knowledge to retain high LL performances and maintain instance-level prompts to learn knowledge shared across different input samples to improve the model's generalization performance. Moreover, we dedicate separate prompts to explicitly model unseen tasks and introduce a set of prompt key vectors to facilitate knowledge sharing between tasks. Extensive experiments demonstrate that Diana outperforms state-of-the-art lifelong QA models, especially in handling unseen tasks.

Over the last years, word and sentence embeddings have established as text preprocessing for all kinds of NLP tasks and improved performances in these tasks significantly. Unfortunately, it has also been shown that these embeddings inherit various kinds of biases from the training data and thereby pass on biases present in society to NLP solutions. Many papers attempted to quantify bias in word or sentence embeddings to evaluate debiasing methods or compare different embedding models, often with cosine-based scores. However, some works have raised doubts about these scores showing that even though they report low biases, biases persist and can be shown with other tests. In fact, there is a great variety of bias scores or tests proposed in the literature without any consensus on the optimal solutions. We lack works that study the behavior of bias scores and elaborate their advantages and disadvantages. In this work, we will explore different cosine-based bias scores. We provide a bias definition based on the ideas from the literature and derive novel requirements for bias scores. Furthermore, we thoroughly investigate the existing cosine-based scores and their limitations in order to show why these scores fail to report biases in some situations. Finally, we propose a new bias score, SAME, to address the shortcomings of existing bias scores and show empirically that SAME is better suited to quantify biases in word embeddings.

This article has been excerpted from The Equality Machine: Harnessing Digital Technology for a Brighter, More Inclusive Future by Orly Lobel. For years, Japan has been the indisputable leader in robotics. If Tanzania's Olduvai Gorge is the cradle of humanity, Japan is the cradle of the humanoids, developing the first humanoid robot in the 1970s and many iterations since. Japanese roboticists pioneered the notion that artificial intelligence should be embodied. While the West focused more on algorithms in the abstract, Japanese institutions believed that AI innovation should be developed alongside--or rather, within--a physical artificial body. Japanese roboticists have been leading the way in realizing the aspiration to create robots that offer companionship to humans for decades.

Abstract: Quantum computers have the potential to speed up certain computational tasks. A possibility this opens up within the field of machine learning is the use of quantum techniques that may be inefficient to simulate classically but could provide superior performance in some tasks. Machine learning algorithms are ubiquitous in particle physics and as advances are made in quantum machine learning technology there may be a similar adoption of these quantum techniques. In this work a quantum support vector machine (QSVM) is implemented for signal-background classification. We investigate the effect of different quantum encoding circuits, the process that transforms classical data into a quantum state, on the final classification performance.

Staring closely at the screen, Jordan Wright deftly picks out a barely distinguishable shape with his mouse, bringing to life a stark blue outline from a blur of overexposed features. It is a process similar to the automated tests that teach computers to distinguish humans from machines, by asking someone to identify traffic lights or stop signs in a picture known as a Captcha. Only in Wright's case, the shape turns out to be of a Tupolev Tu-160, a supersonic strategic heavy bomber, parked on a Russian base. The outline -- one of hundreds a day he picks out from satellite images -- is training an algorithm so that a US intelligence agency can locate and identify Moscow's firepower in an automated flash. It has become a run-of-the-mill task for the 25-year-old, who describes himself as on the autism spectrum. Starting in the spring, Wright began working at Enabled Intelligence Inc, a Virginia-based start-up that works largely for US intelligence and other federal agencies.

Bengio and LeCun see no reason why deep learning systems cannot be made to reason. Said Bengio, "Humans also use some kind of neural nets in their brains, and I believe that there are ways to get to human-like reasoning with deep learning architectures." It was 10 years ago, in 2012, that deep learning made its breakthrough, when an innovative algorithm for classifying images based on multi-layered neural networks suddenly turned out to do spectacularly better than all algorithms before it. That breakthrough has led to deep learning's adoption in domains like speech and image recognition, automatic translation and transcription, and robotics. As deep learning was embedded into ever-more everyday applications, more and more examples of what can go wrong also surfaced: artificial intelligence (AI) systems that discriminate, confirm stereotypes, make inscrutable decisions and require a lot of data and sometimes also a huge amount of energy.

AI has extraordinary potential and developing countries must move forward quickly in this field to leverage their technological prowess, productivity, and competitiveness. Certainly, investing in R&D, developing capacities, and retaining AI talent is much easier said than done. Besides adopting a national AI strategy, if there is none, developing countries could put into practice a roadmap with clearly defined priorities and projects that bolster the economy. They can also build partnerships and reach out to other countries and organizations that are willing to cooperate in frontier technologies. A niche strategy might help to leapfrog in a few select sectors, as in the case of some small states that have become active players in the digital sphere. Interestingly enough, Kenya became last August the first African country to teach coding as a subject in schools. As stated in the UNCTAD 2021 Digital Economy report, developing countries risk becoming mere providers of data, while having to pay for digital intelligence produced with their data. Current international regulatory frameworks tend to be either too narrow in scope or too limited geographically, failing to enable cross-border data flows with an equitable sharing of economic gains. In a nutshell, developing countries need to find the optimal balance between promoting domestic economic development, protecting public policy interests, and integrating into the global digital ecosystem.

This paper proposes a novel prompt-based finetuning method (called DLM-SCS) for few-shot text classification by utilizing the discriminative language model ELECTRA that is pretrained to distinguish whether a token is original or generated. The underlying idea is that the prompt instantiated with the true label should have higher semantic consistency score than other prompts with false labels. Since a prompt usually consists of several components (or parts), its semantic consistency can be decomposed accordingly. The semantic consistency of each component is then computed by making use of the pretrained ELECTRA model, without introducing extra parameters. Extensive experiments have shown that our model outperforms several state-of-the-art prompt-based few-shot methods.

We present Perceive-Represent-Generate (PRG), a novel three-stage framework that maps perceptual information of different modalities (e.g., visual or sound), corresponding to a sequence of instructions, to an adequate sequence of movements to be executed by a robot. In the first stage, we perceive and pre-process the given inputs, isolating individual commands from the complete instruction provided by a human user. In the second stage we encode the individual commands into a multimodal latent space, employing a deep generative model. Finally, in the third stage we convert the multimodal latent values into individual trajectories and combine them into a single dynamic movement primitive, allowing its execution in a robotic platform. We evaluate our pipeline in the context of a novel robotic handwriting task, where the robot receives as input a word through different perceptual modalities (e.g., image, sound), and generates the corresponding motion trajectory to write it, creating coherent and readable handwritten words.