Generative AI
Amazon Tests AI Chatbots That Generate Dialogue on the Fly
The retail giant said today that it will deploy the generative chatbot as an aid to human agents for the time being but plans to eventually have it deal with customers directly. The company is also rolling out a separate consumer-facing chatbot that uses a neural network to better match human-authored response templates to customer queries. The project marks one of the first commercial tests of a state-of-the-art new natural language processing technology that researchers think has the potential to supercharge progress in the field. The model, which has also powered cutting-edge systems like OpenAI's GPT-2, draws on massive training datasets and predictive text to generate realistic-sounding copy or dialogue. "It is difficult to determine what types of conversational models other customer service systems are running, but we are unaware of any announced deployments of end-to-end, neural-network-based dialogue models like ours," wrote Jared Kramer, an applied-science manager on Amazon's Customer Service Tech team, in a blog post. Despite these advances in machine learning, most chatbots on the market today still run on automation rather than true AI.
3 ways AI is transforming the insurance industry
AI researchers continue to develop larger and more complicated models that can tackle more complicated language-related tasks. In the past year, we've seen the release of state-of-the-art language models such as OpenAI's GPT-2 and Google's Meena. While we're still pretty far from developing AI that can truly understand human language, practical uses will emerge from continued advances in natural language processing. AI will do the legwork, gathering import data and highlighting trends in text data, making it easier and less costly for insurers to piece that information together and address their clients' needs.
Elon Musk says AI development should be better regulated, even at Tesla
Tesla CEO Elon Musk wants to see all artificial intelligence better regulated, even at his own company, he tweeted Monday (via TechCrunch). He made the remark in response to a piece about OpenAI by MIT Technology Review, which claimed that the AI organization, co-founded by Musk, has shifted from its mission of developing and distributing AI safely and equitably into a secretive company obsessed with image and driven to constantly raise more money. Musk has a history of expressing serious concerns about the negative potential of AI. He tweeted in 2014 that it could be "more dangerous than nukes," and told an audience at an MIT Aeronautics and Astronautics symposium that year that AI was "our biggest existential threat," and humanity needs to be extremely careful: With artificial intelligence we are summoning the demon. In all those stories where there's the guy with the pentagram and the holy water, it's like yeah he's sure he can control the demon.
Elon Musk calls for regulations on artificial intelligence
Elon Musk is calling for regulation on organizations developing advanced artificial intelligence, including his companies. The Tesla and SpaceX head tweeting earlier this week, "All orgs developing advanced AI should be regulated, including Tesla." Musk was, according to TechCrunch, "responding to a new MIT Technology Review profile of OpenAI, an organization founded in 2015 by Musk, along with Sam Altman, Ilya Sutskever, Greg Brockman, Wojciech Zaremba and John Schulman. Since 2015, Musk has distanced himself from OpenAI and openly criticized it. In a twitter conversation about the group last year, Musk tweeted, "Unfortunately, I must agree that these are reasonable concerns" when user @Smerity asked, "What is OpenAI?
Behavior Cloning in OpenAI using Case Based Reasoning
Peters, Chad, Esfandiari, Babak, Zalat, Mohamad, West, Robert
Learning from Observation (LfO), also known as Behavioral Cloning, is an approach for building software agents by recording the behavior of an expert (human or artificial) and using the recorded data to generate the required behavior. jLOAF is a platform that uses Case-Based Reasoning to achieve LfO. In this paper we interface jLOAF with the popular OpenAI Gym environment. Our experimental results show how our approach can be used to provide a baseline for comparison in this domain, as well as identify the strengths and weaknesses when dealing with environmental complexity.
Cutting-Edge AI: Deep Reinforcement Learning in Python
Link: Cutting-Edge AI: Deep Reinforcement Learning in Python udemy code coupon What you'll learn. Understand a cutting-edge implementation of the A2C algorithm (OpenAI Baselines) Understand and implement Evolution Strategies (ES) for AI. Understand and implement DDPG (Deep Deterministic Policy Gradient) Highest Rated by Lazy Programmer Inc. What you'll learn Understand a cutting-edge implementation of the A2C algorithm (OpenAI Baselines) Understand and implement Evolution Strategies (ES) for AI Understand and implement DDPG (Deep Deterministic Policy Gradient) Description Welcome to Cutting-Edge AI! This is technically Deep Learning in Python part 11 of my deep learning series, and my 3rd reinforcement learning course.
Elon Musk says all advanced AI development should be regulated, including at Tesla โ TechCrunch
Tesla and SpaceX CEO Elon Musk is once again sounding a warning note regarding the development of artificial intelligence. The executive and founder tweeted on Monday evening that "all org[anizations] developing advance AI should be regulated, including Tesla." Musk was responding to a new MIT Technology Review profile of OpenAI, an organization founded in 2015 by Musk, along with Sam Altman, Ilya Sutskever, Greg Brockman, Wojciech Zaremba and John Schulman. At first, OpenAI was formed as a non-profit backed by $1 billion in funding from its pooled initial investors, with the aim of pursuing open research into advanced AI with a focus on ensuring it was pursued in the interest of benefiting society, rather than leaving its development in the hands of a small and narrowly-interested few (i.e., for-profit technology companies). At the time of its founding in 2015, Musk posited that the group essentially arrived at the idea for OpenAI as an alternative to "sit[ting] on the sidelines" or "encourag[ing] regulatory oversight."
Elon Musk warns AI like the kind used in Tesla's autopilot should be regulated by international law
Tesla and SpaceX CEO, Elon Musk, says that AI like the one his companies make should be better regulated. Musk's opinion on the dangers of letting AI proliferate unfettered was prompted by a report published in MIT Technology Review about changing company culture at OpenAI, a technology company that helps develop new AI. Elon Musk formerly helmed the company but left due to conflicts of interest. The report claims that OpenAI has shifted from its goal of equitably distributing AI technology to a more secretive, funding-driven company. 'OpenAI should be more open imo,' he tweeted.
Correlation-aware Deep Generative Model for Unsupervised Anomaly Detection
Fan, Haoyi, Zhang, Fengbin, Wang, Ruidong, Xi, Liang, Zuoyong, null, Li, null
Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns from which the abnormal ones deviate. In this paper, we propose a method of Correlation aware unsupervised Anomaly detection via Deep Gaussian Mixture Model (CADGMM), which captures the complex correlation among data points for high-quality low-dimensional representation learning. More specifically, the relations among data samples are correlated firstly in forms of a graph structure, in which, the node denotes the sample and the edge denotes the correlation between two samples from the feature space. Then, a dual-encoder that consists of a graph encoder and a feature encoder, is employed to encode both the feature and correlation information of samples into the low-dimensional latent space jointly, followed by a decoder for data reconstruction. Finally, a separate estimation network as a Gaussian Mixture Model is utilized to estimate the density of the learned latent vector, and the anomalies can be detected by measuring the energy of the samples. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method.
Using Deep Belief Nets to Learn Covariance Kernels for Gaussian Processes
Hinton, Geoffrey E., Salakhutdinov, Russ R.
We show how to use unlabeled data and a deep belief net (DBN) to learn a good covariance kernel for a Gaussian process. We first learn a deep generative model of the unlabeled data using the fast, greedy algorithm introduced by Hinton et.al. If the data is high-dimensional and highly-structured, a Gaussian kernel applied to the top layer of features in the DBN works much better than a similar kernel applied to the raw input. Performance at both regression and classification can then be further improved by using backpropagation through the DBN to discriminatively fine-tune the covariance kernel. Papers published at the Neural Information Processing Systems Conference.