Deep Learning
Roundtrip: A Deep Generative Neural Density Estimator
Liu, Qiao, Xu, Jiaze, Jiang, Rui, Wong, Wing Hung
Density estimation is a fundamental problem in both statistics and machine learning. In this study, we proposed Roundtrip as a general-purpose neural density estimator based on deep generative models. Roundtrip retains the generative power of generative adversarial networks (GANs) but also provides estimates of density values. Unlike previous neural density estimators that put stringent conditions on the transformation from the latent space to the data space, Roundtrip enables the use of much more general mappings. In a series of experiments, Roundtrip achieves state-of-the-art performance in a diverse range of density estimation tasks.
Notes on Deep Learning -- Getting Started
I thought so too until I had no option but to adopt it and appreciate it's capabilities. Deep Learning is an artificial intelligence function that imitates the workings of the human brain in processing data and creating patterns for use in decision making. Deep learning is a subset of machine learning in Artificial Intelligence (AI) that has networks capable of learning unsupervised from data that is unstructured or unlabeled. Also known as Deep Neural Learning or Deep Neural Network. Evolution of taking decisions -- a comparison of no-system based decisions, rule-based decisions, machine learning based decisions and deep learning based decisions.
5 Models for Conversational AI
How can chatbots become truly intelligent by combining five different models of conversation? Conversational AI is all about making machines communicate with us in natural language. They are called using various names -- chatbots, voice bots, virtual assistants, etc. In reality, they may be slightly different to each other. However one key feature that ties them all together is their ability to understand natural language commands and requests from us-human users. In the back-end, these agents will have to deal with carrying out the request and engage in a conversation.
Global Big Data Conference
Process automation startup Hypatos has raised a €10 million ( $11.8 million) seed round of funding from investors including Blackfin Tech, Grazia Equity, UVC Partners and Plug & Play Ventures. The Germany and Poland-based company was spun out of AI for accounting startup Smacc at the back end of 2018 to apply deep learning tech to power a wider range of back-office automation, with a focus on industries with heavy financial document processing needs, such as the financial and insurance sectors. Hypatos is applying language processing AI and computer vision tech to speed up financial document processing for business use cases such as invoices, travel and expense management, loan application validation and insurance claims handling via -- touting a training data set of more than 10 million annotated data entities. It says the new seed funding will go on R&D to expand its portfolio of AI models so it can automate business processing for more types of documents, as well as for fueling growth in Europe, North American and Asia. Its customer base at this point includes Fortune 500 companies, major accounting firms and more than 300 software companies.
Developing Deep Learning Models for Pathology Analysis
Ahead of the 6th Digital Pathology & AI Congress: USA, Dr Saeed Hassanpour introduces us to the subject of his presentation: the opportunities and challenges in developing deep learning based tools for histology. In the last decade, there has been massive progress in the artificial intelligence (AI) field, particularly in the domain of deep learning. This progress presents new opportunities for various domains dealing with images, particularly medical imaging. At the Hassanpour lab, we are harnessing advances in AI to enable pathologists to analyze and understand their data. The applications are particularly applicable for histology images.
Deep Learning in Natural Language Processing: History and Achievements - Exxact
As we grow, we learn how to use language to communicate with people around us. First, we master our native language: listen to how family members and other children speak and repeat after them; memorize words as they relate to every object and phenomenon; learn sentence structure, punctuation, and other rules of written language. We may repeat a similar path when learning a foreign language. And this lifelong learning and practice come naturally to us, although not without some effort. Unlike humans, early computers were unable to understand speech or the written word and could only react to a specific set of commands.
Machine Learning Basics for Developers
In the current tech landscape, developers are expected to have a number of different skills. And many of them do. There are also a lot of different career paths available to developers that use many of their current skills with a slight twist. Database administrators, developer advocates, and machine learning engineers all have one thing in common with all developers: they all know how to code. It doesn't matter which languages are being used, they all understand the core concepts behind writing good code. That's one of the reasons many software developers consider becoming machine learning engineers. With all of the tools and packages available, you don't need to have a deep mathematical background to get accurate results. If you are willing to learn how to use some libraries and get a high-level understanding of the underlying math, you can become a machine learning engineer.
Generating Piano Music with Dilated Convolutional Neural Networks
A considerable amount of research has been devoted to training deep neural networks that can compose piano music. For example, Musenet, developed by OpenAI, has trained large-scale transformer models capable of composing realistic piano pieces that are many minutes in length. The model used by Musenet adopts many of the technologies, such as attention layers, that were originally developed for NLP tasks. See this previous TDS post for more details on applying attention-based models to music generation. Although NLP-based methods are a fantastic fit for machine-based music generation (after all, music is like a language), the transformer model architecture is somewhat involved, and proper data preparation and training can require great care and experience. In particular, I'll focus on fully convolutional neural networks based on dilated convolutions, which require only a handful of lines of code to define, take minimal data preparation, and are easy to train. In 2016, DeepMind researchers introduced the WaveNet model architecture,¹ which yielded state-of-the-art performance in speech synthesis. Their research demonstrated that stacked 1D convolutional layers with exponentially growing dilation rates can process sequences of raw audio waveforms extremely efficiently, leading to generative models that can synthesize convincing audio from a variety of sources, including piano music. In this post, I build upon DeepMind's research, with an explicit focus on generating piano music.
Google Maps is improving travel ETAs with DeepMind AI
Google Maps helps users navigate over one billion kilometers in more than 200 countries and territories daily, and Google says its estimated time of arrival (ETA) predictions have been consistently accurate for over 97 percent of trips. That's not good enough for Google, though, so the company partnered with DeepMind to use machine learning to make its ETAs even more accurate. Before partnering with DeepMind, an Alphabet AI research lab, Google Maps used a combination of historical traffic patterns and live traffic conditions to understand current traffic patterns. The partners wanted to be able to predict future traffic patterns, so DeepMind developed a graphic neural network, which also considers data on the time of year, road quality, speed limits, accidents and closures. Thanks to that machine learning approach, Google Maps has improved the accuracy of real-time ETAs by up to 50 percent in places like Berlin, Jakarta, São Paulo, Sydney, Tokyo, and Washington D.C. Now, Google Maps can warn users about traffic jams before they exist.