Goto

Collaborating Authors

 Generative AI


AI: A Force for Good or Bad?

#artificialintelligence

This week, Elon Musk praised the work of OpenAI after a team of five neural networks had defeated five humans, who ranked in the top 99.95 percentile of players worldwide, in the popular game Dota 2. The five bots had learned the game by playing against itself at a rate of a staggering 180 years per day. The game requires strong teamwork among the five players and, therefore, the achievement is quite remarkable and more evidence that artificial intelligence (AI) is rapidly becoming more advanced. However, directly after the five bots beat the five humans 2-1, Musk cautioned for the power of AI by urging that OpenAI should focus on AI that works with humans, instead of against humans. His statement is in line with his previous warnings for AI, which Musk believes could result in a robot dictatorship or an AI-arms race amongst superpowers that could be the most plausible cause for World War III. With artificial intelligence becoming increasingly sophisticated, also the warnings against AI become more pervasive, and the question remains then, is AI good or bad?


r/MachineLearning - [N] Stable-Baselines v2.0.0 Released

#artificialintelligence

Has anyone tried to use Stable-Baselines? How does it compare to the official Baselines from OpenAI in your experience? Stable Baselines is a set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines. You can read a detailed presentation of Stable Baselines in the Medium article. These algorithms will make it easier for the research community and industry to replicate, refine, and identify new ideas, and will create good baselines to build projects on top of.


Thinking Like a Human: What It Means to Give AI a Theory of Mind

#artificialintelligence

Last month, a team of self-taught AI gamers lost spectacularly against human professionals in a highly-anticipated galactic melee. Taking place as part of the International Dota 2 Championships in Vancouver, Canada, the game showed that in broader strategic thinking and collaboration, humans still remain on top. The AI was a series of algorithms developed by the Elon Musk-backed non-profit OpenAI. Collectively dubbed the OpenAI Five, the algorithms use reinforcement learning to teach themselves how to play the game--and collaborate with each other--from scratch. Unlike chess or Go, the fast-paced multi-player Dota 2 video game is considered much harder for computers.


r/artificial - Ilya Sutskever says OpenAI Five bot is like a honeybee brain in terms its number of FLOPS.

#artificialintelligence

He said the main part of its RL policy is implemented by a 4,000 dimensional LSTM network, which has roughly 100 million (10 9) parameters .He also said that in terms of Flops, it is like a honeybee brain. This means the OpenAI Dota2 bot has roughly the same number of parameters as honeybee brain (Assumption: real synapse weight can be represented by 1 Byte of memory, which is often the case in artificial neural network systems). If the former is more intelligent, it suggests that modern machine learning algorithm is more capable than natural selection at turning a certain size of parameters into intelligence. It is probable that the same algorithm can turn them into super-mice or super-cat intelligence.


A Deep Generative Model for Semi-Supervised Classification with Noisy Labels

arXiv.org Machine Learning

Class labels are often imperfectly observed, due to mistakes and to genuine ambiguity among classes. We propose a new semi-supervised deep generative model that explicitly models noisy labels, called the Mislabeled VAE (M-VAE). The M-VAE can perform better than existing deep generative models which do not account for label noise. Additionally, the derivation of M-VAE gives new theoretical insights into the popular M1+M2 semi-supervised model.


f-VAEs: Improve VAEs with Conditional Flows

arXiv.org Machine Learning

In this paper, we integrate VAEs and flow-based generative models successfully and get f-VAEs. Compared with VAEs, f-VAEs generate more vivid images, solved the blurred-image problem of VAEs. Compared with flow-based models such as Glow, f-VAE is more lightweight and converges faster, achieving the same performance under smaller-size architecture. Recently, deep generative models has been widely studied and developed. Outside of Generative Adversarial Networks (GANs) (Goodfellow et al. 2014), Variational Autoencoders (VAEs) (Kingma and Welling 2013) and flow-based models (Dinh, Krueger, and Bengio 2014; Dinh, Sohldickstein, and Bengio 2016) are two distinct kinds of competitive generative models. They have their own advantages and disadvantages, and we try to integrate them to a new model.


Geodesic Clustering in Deep Generative Models

arXiv.org Machine Learning

Deep generative models are tremendously successful in learning low-dimensional latent representations that well-describe the data. These representations, however, tend to much distort relationships between points, i.e. pairwise distances tend to not reflect semantic similarities well. This renders unsupervised tasks, such as clustering, difficult when working with the latent representations. We demonstrate that taking the geometry of the generative model into account is sufficient to make simple clustering algorithms work well over latent representations. Leaning on the recent finding that deep generative models constitute stochastically immersed Riemannian manifolds, we propose an efficient algorithm for computing geodesics (shortest paths) and computing distances in the latent space, while taking its distortion into account. We further propose a new architecture for modeling uncertainty in variational autoencoders, which is essential for understanding the geometry of deep generative models. Experiments show that the geodesic distance is very likely to reflect the internal structure of the data.


AI-Operated Robot Hand Taught Itself To Manipulate Objects Like A Human

#artificialintelligence

OpenAI, an Elon Musk-backed AI research company, developed a robotic hand that is able to teach itself how to manipulate objects with a human-like dexterity. For more videos, subscribe to Mashable Daily: http://on.mash.to/SubscribeNews Give us a follow: Facebook: https://www.facebook.com/mashable/


A simple probabilistic deep generative model for learning generalizable disentangled representations from grouped data

arXiv.org Machine Learning

The disentangling problem is to discover multiple complex factors of variations hidden in data. One recent approach is to take a dataset with grouping structure and separately estimate a factor common within a group (content) and a factor specific to each group member (transformation). Notably, this approach can learn to represent a continuous space of contents, which allows for generalization to data with unseen contents. In this study, we aim at cultivating this approach within probabilistic deep generative models. Motivated by technical complication in existing group-based methods, we propose a simpler probabilistic method, called group-contrastive variational autoencoders. Despite its simplicity, our approach achieves reasonable disentanglement with generalizability for three grouped datasets of 3D object images. In comparison with a previous model, although conventional qualitative evaluation shows little difference, our qualitative evaluation using few-shot classification exhibits superior performances for some datasets. We analyze the content representations from different methods and discuss their transformation-dependency and potential performance impacts.


GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentation

arXiv.org Artificial Intelligence

Recent success in deep learning has generated immense interest among practitioners and students, inspiring many to learn about this new technology. While visual and interactive approaches have been successfully developed to help people more easily learn deep learning, most existing tools focus on simpler models. In this work, we present GAN Lab, the first interactive visualization tool designed for non-experts to learn and experiment with Generative Adversarial Networks (GANs), a popular class of complex deep learning models. With GAN Lab, users can interactively train generative models and visualize the dynamic training process's intermediate results. GAN Lab tightly integrates an model overview graph that summarizes GAN's structure, and a layered distributions view that helps users interpret the interplay between submodels. GAN Lab introduces new interactive experimentation features for learning complex deep learning models, such as step-by-step training at multiple levels of abstraction for understanding intricate training dynamics. Implemented using TensorFlow.js, GAN Lab is accessible to anyone via modern web browsers, without the need for installation or specialized hardware, overcoming a major practical challenge in deploying interactive tools for deep learning.