Goto

Collaborating Authors

 Africa


SocialInteractionGAN: Multi-person Interaction Sequence Generation

arXiv.org Machine Learning

Prediction of human actions in social interactions has important applications in the design of social robots or artificial avatars. In this paper, we model human interaction generation as a discrete multi-sequence generation problem and present SocialInteractionGAN, a novel adversarial architecture for conditional interaction generation. Our model builds on a recurrent encoder-decoder generator network and a dual-stream discriminator. This architecture allows the discriminator to jointly assess the realism of interactions and that of individual action sequences. Within each stream a recurrent network operating on short subsequences endows the output signal with local assessments, better guiding the forthcoming generation. Crucially, contextual information on interacting participants is shared among agents and reinjected in both the generation and the discriminator evaluation processes. We show that the proposed SocialInteractionGAN succeeds in producing high realism action sequences of interacting people, comparing favorably to a diversity of recurrent and convolutional discriminator baselines. Evaluations are conducted using modified Inception Score and Fr{\'e}chet Inception Distance metrics, that we specifically design for discrete sequential generated data. The distribution of generated sequences is shown to approach closely that of real data. In particular our model properly learns the dynamics of interaction sequences, while exploiting the full range of actions.


Topical Language Generation using Transformers

arXiv.org Artificial Intelligence

Large-scale transformer-based language models (LMs) demonstrate impressive capabilities in open text generation. However, controlling the generated text's properties such as the topic, style, and sentiment is challenging and often requires significant changes to the model architecture or retraining and fine-tuning the model on new supervised data. This paper presents a novel approach for Topical Language Generation (TLG) by combining a pre-trained LM with topic modeling information. We cast the problem using Bayesian probability formulation with topic probabilities as a prior, LM probabilities as the likelihood, and topical language generation probability as the posterior. In learning the model, we derive the topic probability distribution from the user-provided document's natural structure. Furthermore, we extend our model by introducing new parameters and functions to influence the quantity of the topical features presented in the generated text. This feature would allow us to easily control the topical properties of the generated text. Our experimental results demonstrate that our model outperforms the state-of-the-art results on coherency, diversity, and fluency while being faster in decoding.


Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs

arXiv.org Artificial Intelligence

Several pieces of work have uncovered performance disparities by conducting "disaggregated evaluations" of AI systems. We build on these efforts by focusing on the choices that must be made when designing a disaggregated evaluation, as well as some of the key considerations that underlie these design choices and the tradeoffs between these considerations. We argue that a deeper understanding of the choices, considerations, and tradeoffs involved in designing disaggregated evaluations will better enable researchers, practitioners, and the public to understand the ways in which AI systems may be underperforming for particular groups of people.


An Amharic News Text classification Dataset

arXiv.org Artificial Intelligence

In NLP, text classification is one of the primary problems we try to solve and its uses in language analyses are indisputable. The lack of labeled training data made it harder to do these tasks in low resource languages like Amharic. The task of collecting, labeling, annotating, and making valuable this kind of data will encourage junior researchers, schools, and machine learning practitioners to implement existing classification models in their language. In this short paper, we aim to introduce the Amharic text classification dataset that consists of more than 50k news articles that were categorized into 6 classes. This dataset is made available with easy baseline performances to encourage studies and better performance experiments.


Top Artificial Intelligence Influencers To Follow

#artificialintelligence

This is a live list of top trending artificial intelligence experts/influencers from around the world. This list is last updated on March 8, 2021. This post will be updated regularly to reflect any new updates in the list. Here is our list updated as on March 8, 2021. Yoshua Bengio: Yoshua Bengio is a Canadian computer scientist, most noted for his work on artificial neural networks and deep learning.


Interpretable bias mitigation for textual data: Reducing gender bias in patient notes while maintaining classification performance

arXiv.org Machine Learning

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing interest in building algorithmic fairness into processes impacting patient care. Much of the work addressing this question has focused on biases encoded in language models -- statistical estimates of the relationships between concepts derived from distant reading of corpora. Building on this work, we investigate how word choices made by healthcare practitioners and language models interact with regards to bias. We identify and remove gendered language from two clinical-note datasets and describe a new debiasing procedure using BERT-based gender classifiers. We show minimal degradation in health condition classification tasks for low- to medium-levels of bias removal via data augmentation. Finally, we compare the bias semantically encoded in the language models with the bias empirically observed in health records. This work outlines an interpretable approach for using data augmentation to identify and reduce the potential for bias in natural language processing pipelines.


UnICORNN: A recurrent model for learning very long time dependencies

arXiv.org Machine Learning

The design of recurrent neural networks (RNNs) to accurately process sequential inputs with long-time dependencies is very challenging on account of the exploding and vanishing gradient problem. To overcome this, we propose a novel RNN architecture which is based on a structure preserving discretization of a Hamiltonian system of second-order ordinary differential equations that models networks of oscillators. The resulting RNN is fast, invertible (in time), memory efficient and we derive rigorous bounds on the hidden state gradients to prove the mitigation of the exploding and vanishing gradient problem. A suite of experiments are presented to demonstrate that the proposed RNN provides state of the art performance on a variety of learning tasks with (very) long time-dependencies.


Lidar Crop Classification with Data Fusion and Machine Learning

#artificialintelligence

Crop type maps are frequently generated using remotely sensed data acquired by sensors mounted on satellites, manned aircraft or unmanned aerial vehicles (UAVs or'drones'), the most popular being multispectral sensors mounted on satellites. Aerial multispectral sensors are more frequently employed where imagery with very high spatial resolution is required. However, the use of Lidar data for crop type mapping is still uncommon. This article outlines research done on creating crop type maps using Lidar, Sentinel-2 and aerial data along with several machine learning classification algorithms for differentiating four crop types in an intensively cultivated area. Lidar data is becoming ever-more widely available as more aerial surveys are conducted, UAV-Lidar sensors are becoming more prevalent and Earth observation satellites are being fitted with Lidar sensors.


Multimodal Neurons in Artificial Neural Networks

#artificialintelligence

We've discovered neurons in CLIP that respond to the same concept whether presented literally, symbolically, or conceptually. This may explain CLIP's accuracy in classifying surprising visual renditions of concepts, and is also an important step toward understanding the associations and biases that CLIP and similar models learn. Fifteen years ago, Quiroga et al. discovered that the human brain possesses multimodal neurons. These neurons respond to clusters of abstract concepts centered around a common high-level theme, rather than any specific visual feature. The most famous of these was the "Halle Berry" neuron, a neuron featured in both Scientific American and The New York Times, that responds to photographs, sketches, and the text "Halle Berry" (but not other names).


How Artificial Intelligence Can Help With Efficiency in Healthcare

#artificialintelligence

This article was originally published February 23, 2021 on PSQH by Matt Phillion. An aging population, a shortage of clinicians, and an abundance of data--treating patients grows more and more complicated all the time. Leveraging available and emerging technology to maximize efficiency, however, offers a chance to improve care in innovative ways. "The population is aging, and more and more people are suffering from cardiac issues. Expertise is expensive, and there is limited access to those experts," says Jia Li, co-founder of Cardiologs, a medical technology company developing medical-grade artificial intelligence (AI) and cloud technology to improve cardiac diagnoses.