Deep Learning
Amazon Tests AI Chatbots That Generate Dialogue on the Fly
The retail giant said today that it will deploy the generative chatbot as an aid to human agents for the time being but plans to eventually have it deal with customers directly. The company is also rolling out a separate consumer-facing chatbot that uses a neural network to better match human-authored response templates to customer queries. The project marks one of the first commercial tests of a state-of-the-art new natural language processing technology that researchers think has the potential to supercharge progress in the field. The model, which has also powered cutting-edge systems like OpenAI's GPT-2, draws on massive training datasets and predictive text to generate realistic-sounding copy or dialogue. "It is difficult to determine what types of conversational models other customer service systems are running, but we are unaware of any announced deployments of end-to-end, neural-network-based dialogue models like ours," wrote Jared Kramer, an applied-science manager on Amazon's Customer Service Tech team, in a blog post. Despite these advances in machine learning, most chatbots on the market today still run on automation rather than true AI.
How Artificial Intelligence Is Impacting Banking UK Waracle
Artificial Intelligence (AI) is having a seismic impact across the banking industry. Its utilisation is broad and diverse, ranging in application from chatbots and virtual assistants to profiling customers, streamlining processes, identifying trends and patterns in customer behaviour and risk management. If you're new to the world of AI, getting to grips with the terminology can seem daunting, but getting started in AI is way more straightforward than you might think โ and the rewards for taking action early can be vast in terms of keeping your customers happy, providing a unique competitive edge for your business and reaping the associated commercial rewards. According to industry analysts, AI has the potential to drive one of the greatest and most profound technological revolutions in modern history. Artificial Intelligence, or AI as its more commonly referred, relates to the design and creation of systems, machines or applications that possess the ability to undertake complex tasks traditionally performed by humans.
PostDoc Researcher - Graph Representation Learning and Explainable AI ai-jobs.net
Accenture Labs Dublin is looking for a Post-Doctoral researcher in the domain of Graph Representation Learning and Explainable AI. You will be in charge of designing interpretable machine learning models to infer knowledge from a graph of clinical, genomic, and behavioural data. Explanations will use a wide range of techniques, such as rules derived from the deep learning models, gradient-based attribution methods, or graph-based explanations based on network analysis. The length of the PostDoc is 3 years. You will join a multi-partner project whose goal is identifying factors that can cause development of new medical conditions, and worsen the quality of life of cancer survivors.
Data Science, Convolutional Neural Networks, and Machine Learning in the Cloud (Part 3 of 4)
This is Part 3 of a four-part series that breaks up a talk that I gave at the Toronto AI Meetup. In this video we go more in depth into an example of a common data science process, how convolutions work in convolutional neural networks, and finally how this can be done in the cloud using Azure Machine Learning. The AI Show's Favorite links: Don't miss new episodes, subscribe to the AI Show: https://aka.ms/aishowsubscribe
Audio Data Analysis Using Deep Learning with Python (Part 2) - KDnuggets
In the previous article, we started our discussion about audio signals; we saw how we can interpret and visualize them using Librosa python library. We also learned how to extract necessary features from a sound/audio file. We concluded the previous article by building an Artificial Neural Network(ANN) for the music genre classification. In this article, we are going to build a Convolutional Neural Network for music genre classification. Nowadays, deep learning is more and more used for Music Genre Classification: particularly Convolutional Neural Networks (CNN) taking as entry a spectrogram considered as an image on which are sought different types of structure.
Deep Randomized Neural Networks
Gallicchio, Claudio, Scardapane, Simone
Randomized Neural Networks explore the behavior of neural systems where the majority of connections are fixed, either in a stochastic or a deterministic fashion. Typical examples of such systems consist of multi-layered neural network architectures where the connections to the hidden layer(s) are left untrained after initialization. Limiting the training algorithms to operate on a reduced set of weights inherently characterizes the class of Randomized Neural Networks with a number of intriguing features. Among them, the extreme efficiency of the resulting learning processes is undoubtedly a striking advantage with respect to fully trained architectures. Besides, despite the involved simplifications, randomized neural systems possess remarkable properties both in practice, achieving state-of-the-art results in multiple domains, and theoretically, allowing to analyze intrinsic properties of neural architectures (e.g. before training of the hidden layers' connections). In recent years, the study of Randomized Neural Networks has been extended towards deep architectures, opening new research directions to the design of effective yet extremely efficient deep learning models in vectorial as well as in more complex data domains. This chapter surveys all the major aspects regarding the design and analysis of Randomized Neural Networks, and some of the key results with respect to their approximation capabilities. In particular, we first introduce the fundamentals of randomized neural models in the context of feed-forward networks (i.e., Random Vector Functional Link and equivalent models) and convolutional filters, before moving to the case of recurrent systems (i.e., Reservoir Computing networks). For both, we focus specifically on recent results in the domain of deep randomized systems, and (for recurrent models) their application to structured domains.
MetFlow: A New Efficient Method for Bridging the Gap between Markov Chain Monte Carlo and Variational Inference
Thin, Achille, Kotelevskii, Nikita, Denain, Jean-Stanislas, Grinsztajn, Leo, Durmus, Alain, Panov, Maxim, Moulines, Eric
In this contribution, we propose a new computationally efficient method to combine Variational Inference (VI) with Markov Chain Monte Carlo (MCMC). This approach can be used with generic MCMC kernels, but is especially well suited to \textit{MetFlow}, a novel family of MCMC algorithms we introduce, in which proposals are obtained using Normalizing Flows. The marginal distribution produced by such MCMC algorithms is a mixture of flow-based distributions, thus drastically increasing the expressivity of the variational family. Unlike previous methods following this direction, our approach is amenable to the reparametrization trick and does not rely on computationally expensive reverse kernels. Extensive numerical experiments show clear computational and performance improvements over state-of-the-art methods.
Triangle-Net: Towards Robustness in Point Cloud Classification
3D object recognition is becoming a key desired capability for many computer vision systems such as autonomous vehicles, service robots and surveillance drones to operate more effectively in unstructured environments. These real-time systems require effective classification methods that are robust to sampling resolution, measurement noise, and pose configuration of the objects. Previous research has shown that sparsity, rotation and positional variance of points can lead to a significant drop in the performance of point cloud based classification techniques. In this regard, we propose a novel approach for 3D classification that takes sparse point clouds as input and learns a model that is robust to rotational and positional variance as well as point sparsity. To this end, we introduce new feature descriptors which are fed as an input to our proposed neural network in order to learn a robust latent representation of the 3D object. We show that such latent representations can significantly improve the performance of object classification and retrieval. Further, we show that our approach outperforms PointNet and 3DmFV by 34.4% and 27.4% respectively in classification tasks using sparse point clouds of only 16 points under arbitrary SO(3) rotation.
Learning to Resolve Alliance Dilemmas in Many-Player Zero-Sum Games
Hughes, Edward, Anthony, Thomas W., Eccles, Tom, Leibo, Joel Z., Balduzzi, David, Bachrach, Yoram
Zero-sum games have long guided artificial intelligence research, since they possess both a rich strategy space of best-responses and a clear evaluation metric. What's more, competition is a vital mechanism in many real-world multi-agent systems capable of generating intelligent innovations: Darwinian evolution, the market economy and the AlphaZero algorithm, to name a few. In two-player zero-sum games, the challenge is usually viewed as finding Nash equilibrium strategies, safeguarding against exploitation regardless of the opponent. While this captures the intricacies of chess or Go, it avoids the notion of cooperation with co-players, a hallmark of the major transitions leading from unicellular organisms to human civilization. Beyond two players, alliance formation often confers an advantage; however this requires trust, namely the promise of mutual cooperation in the face of incentives to defect. Successful play therefore requires adaptation to co-players rather than the pursuit of non-exploitability. Here we argue that a systematic study of many-player zero-sum games is a crucial element of artificial intelligence research. Using symmetric zero-sum matrix games, we demonstrate formally that alliance formation may be seen as a social dilemma, and empirically that na\"ive multi-agent reinforcement learning therefore fails to form alliances. We introduce a toy model of economic competition, and show how reinforcement learning may be augmented with a peer-to-peer contract mechanism to discover and enforce alliances. Finally, we generalize our agent model to incorporate temporally-extended contracts, presenting opportunities for further work.