Goto

Collaborating Authors

 Deep Learning


Transparency in AI: Rainbird CEO on what developers need to know - CW Developer Network

#artificialintelligence

As a result, transparency has become a technical issue that companies are grappling with during development. So, what do developers need to consider when it comes to building transparency into AI systems? The biggest issues regarding transparency tend to arise through implementation of statistical methods of data analysis or machine learning. Machine Learning is a powerful technique in the developer's toolkit, allowing algorithms to be designed that learn the solutions to problems from data, rather than being explicitly programmed. Unfortunately, most Machine Learning techniques are black box by nature. Take Convolutional Neural Networks (CNN), for example: this popular deep learning technique โ€“ often used for image classification tasks โ€“ relies on a large network of weighted nodes.


How Artificial Intelligence will radically transform Education

#artificialintelligence

Artificial intelligence startup founder Joel Hellermark is pioneering the development of algorithms that will radically transform education. Using deep neural networks, algorithms personalize educational content in real time based on how the student learns, what they've already mastered, and what works best for similar students. Joel Hellermark is the founder and CEO of Sana which is an artificial intelligence company that applies recent breakthroughs in deep learning to personalise education. The Sana team is made up of engineers and scientists with backgrounds ranging from Imperial College and CERN to Google and Spotify.


The Blunt Guide to Mathematically Rigorous Machine Learning

#artificialintelligence

I recently wrote a brief guide on the Math required for Machine Learning. People liked it, and asked me to write one on how to master ML at a mathematically rigorous, conceptual level. That is the focus of this guide, no bullshit, no easy routes, and real, fundamental understanding. I'll be going through the later part of the curriculum myself. A quick question to ask yourself: Why do I want to learn ML?


A brighter future for Artificial Intelligence for business with HPE and Bright Computing

#artificialintelligence

Ready for AI? Discover our purpose-built integrated hardware and software solution based on Apollo 6500 Gen10 systems with Bright Cluster Manager for Data Science. You've decided that AI is the future, and you want to embrace it to stay ahead of your competition. You've got plenty of data to analyze and a team of data scientists ready to go, but they require an environment in which to ply their craft. You need hardware and software that work well together, and a way to quickly adapt to the environment and keep up with the rapidly evolving world of machine learning, deep learning and AI. That's why HPE and Bright Computing have joined forces to bring you a purpose-built, integrated hardware and software solution you can put to work in no time.


PAC-learning is Undecidable

arXiv.org Machine Learning

The problem of attempting to learn the mapping between data and labels is the crux of any machine learning task. It is, therefore, of interest to the machine learning community on practical as well as theoretical counts to consider the existence of a test or criterion for deciding the feasibility of attempting to learn. We investigate the existence of such a criterion in the setting of PAC-learning, basing the feasibility solely on whether the mapping to be learnt lends itself to approximation by a given class of hypothesis functions. We show that no such criterion exists, exposing a fundamental limitation in the decidability of learning. In other words, we prove that testing for PAC-learnability is undecidable in the Turing sense. We also briefly discuss some of the probable implications of this result to the current practice of machine learning.


Out-of-Distribution Detection using Multiple Semantic Label Representations

arXiv.org Machine Learning

Deep Neural Networks are powerful models that attained remarkable results on a variety of tasks. These models are shown to be extremely efficient when training and test data are drawn from the same distribution. However, it is not clear how a network will act when it is fed with an out-of-distribution example. In this work, we consider the problem of out-of-distribution detection in neural networks. We propose to use multiple semantic dense representations instead of sparse representation as the target label. Specifically, we propose to use several word representations obtained from different corpora or architectures as target labels. We evaluated the proposed model on computer vision, and speech commands detection tasks and compared it to previous methods. Results suggest that our method compares favorably with previous work. Besides, we present the efficiency of our approach for detecting wrongly classified and adversarial examples.


Learning to Exploit Invariances in Clinical Time-Series Data using Sequence Transformer Networks

arXiv.org Machine Learning

Recently, researchers have started applying convolutional neural networks (CNNs) with onedimensional convolutions to clinical tasks involving time-series data. This is due, in part, to their computational efficiency, relative to recurrent neural networks and their ability to efficiently exploit certain temporal invariances, (e.g., phase invariance). However, it is wellestablished that clinical data may exhibit many other types of invariances (e.g., scaling). While preprocessing techniques, (e.g., dynamic time warping) may successfully transform and align inputs, their use often requires one to identify the types of invariances in advance. In contrast, we propose the use of Sequence Transformer Networks, an end-to-end trainable architecture that learns to identify and account for invariances in clinical time-series data. Applied to the task of predicting in-hospital mortality, our proposed approach achieves an improvement in the area under the receiver operating characteristic curve (AUROC) relative to a baseline CNN (AUROC 0.851 vs. AUROC 0.838). Our results suggest that a variety of valuable invariances can be learned directly from the data.


Ithemal: Accurate, Portable and Fast Basic Block Throughput Estimation using Deep Neural Networks

arXiv.org Machine Learning

Statically estimating the number of processor clock cycles it takes to execute a basic block of assembly instructions in steady state (throughput) is important for compiler backend optimizations such as register allocation, instruction selection and instruction scheduling. This is complicated specially in modern x86-64 Complex Instruction Set Computer (CISC) machines with sophisticated processor microarchitectures. Traditionally, compiler writers invest time experimenting and referring to processor manuals to analytically model modern processors with incomplete specifications. This is tedious, error prone and should be done for each processor generation. We present Ithemal, the first automatically learnt estimator to statically predict throughput of a set of basic block instructions using machine learning. Ithemal uses a novel Directed Acyclic Graph-Recurrent Neural Network (DAG-RNN) based data-driven approach for throughput estimation. We show that Ithemal is accurate than state-of-the-art hand written tools used in compiler backends and static machine code analyzers. In particular, our model has a worst case average error of 10.53% on actual throughput values when compared to best case average errors of 19.57% for the LLVM scheduler (llvm-mca) and 22.51% for IACA, Intel's machine code analyzer when compared on three different microarchitectures, while predicting throughput values at a faster rate than aforementioned tools. We also show that Ithemal is portable, learning throughput estimation for Intel Nehalem, Haswell and Skylake microarchitectures without requiring changes to its structure.


Synthetic Patient Generation: A Deep Learning Approach Using Variational Autoencoders

arXiv.org Machine Learning

Artificial Intelligence in healthcare is a new and exciting frontier and the possibilities are endless. With deep learning approaches beating human performances in many areas, the logical next step is to attempt their application in the health space. For these and other Machine Learning approaches to produce good results and have their potential realized, the need for, and importance of, large amounts of accurate data is second to none. This is a challenge faced by many industries and more so in the healthcare space. We present an approach of using Variational Autoencoders (VAE's) as an approach to generating more data for training deeper networks, as well as uncovering underlying patterns in diagnoses and the patients suffering from them. By training a VAE, on available data, it was able to learn the latent distribution of the patient features given the diagnosis. It is then possible, after training, to sample from the learnt latent distribution to generate new accurate patient records given the patient diagnosis.


Wrapped Loss Function for Regularizing Nonconforming Residual Distributions

arXiv.org Machine Learning

Multi-output is essential in machine learning that it might suffer from nonconforming residual distributions, i.e., the multi-output residual distributions are not conforming to the expected distribution. In this paper we propose "Wrapped Loss Function" to wrap the original loss function to alleviate the problem. This wrapped loss function acts just like original loss function that its gradient can be used for backpropagation optimization. Empirical evaluations show wrapped loss function has advanced properties of faster convergence, better accuracy and improving imbalanced data.