Goto

Collaborating Authors

 Deep Learning


What are convolutional neural networks (CNN)?

#artificialintelligence

This article is part of Demystifying AI, a series of posts that (try to) disambiguate the jargon and myths surrounding AI. Since the 1950s, the early days of artificial intelligence, computer scientists have been trying to build computers that can make sense of visual data. In the ensuing decades, the field, which has become known as computer vision, saw incremental advances. In 2012, computer vision took a quantum leap when a group of researchers from the University of Toronto developed an AI model that surpassed the best image recognition algorithms by a large margin. The AI system, which became known as AlexNet (named after its main creator, Alex Krizhevsky), won the 2012 ImageNet computer vision contest with an amazing 85 percent accuracy.


Top 7 Python Libraries For Reinforcement Learning

#artificialintelligence

In recent years, the emergence of deep reinforcement learning (RL) has resulted in the growing demand for their evaluation. To implement and test RL models quickly and reliably, several RL libraries have been developed. Pyqlearning is a Python library to implement RL, especially for Q-Learning and multi-agent Deep Q-Network. This library makes it possible to design the information search algorithm such as the Game AI, web crawlers, or robotics. Keras-RL seamlessly implements state-of-the-art deep reinforcement learning algorithms with the deep learning library Keras.


3rd Physics Informed Machine Learning

#artificialintelligence

This workshop continues discussions and explorations started in January 2016 and January 2018 at the first and second editions of the workshop. A revolution in statistics and machine learning (ML) is underway. Modern algorithms can now learn high level abstractions via hierarchical models, leading to break- through accuracy in benchmarks for computer vision, language, etc. Underlying these advances is a strong and deep connection to various aspects of applied mathematics and statistical physics. For example, proper choice of statistical force allows to screen interaction and learn graphical models governing multi-dimensional distributions efficiently, gauge transformations from physics guide incorporation of symmetries in the neural network design, dynamical system interpretation helps to understand and improve performance of most efficient deep learning schemes, etc. This workshop seeks perspectives on leveraging the deep connection between ML and physics, but now with the goal to better understand and model physical systems, static and dynamic.


Machine Learning for CEOs

#artificialintelligence

When I worked as a McKinsey consultant, I served the CEO of a bank regarding his small business strategy. I wanted to run regressions on the bank's data but I was advised against it: "They don't even understand statistics. How are you going to explain a regression to them?". CEOs have always needed to deeply understand human intelligence and emotion to manage enterprise teams. Now machines and algorithms are increasingly becoming part of these very teams.


Time for AI to get specialized?

#artificialintelligence

Aurora will be required to multi-task, hence the necessity for powerful GPUs. Hazra said: "As high-performance computing moves from traditional modeling and simulation to the advent of data, there will be a drive for diverse computing needs, which will [spur] a new tailwind for heterogeneous computing. "One size doesn't fit all. We must look at the architectures [and how they are] tuned to the various needs of this era. "If you need a general-purpose solution then Ponte Vecchio has already described its leadership performance [for] when you get those workloads that have tremendous bandwidth requirements and dense floating-point operations. "If you were then to take the next step and say'I am very, very interested in the best possible performance for AI deep learning, Training and Inference,' that's what our NNP families are for.


Challenges to the Reproducibility of Machine Learning Models in Health Care - Docwire News

#artificialintelligence

Reproducibility has been an important and intensely debated topic in science and medicine for the past few decades.1 As the scientific enterprise has grown in scope and complexity, concerns regarding how well new findings can be reproduced and validated across different scientific teams and study populations have emerged. In some instances,2 the failure to replicate numerous previous studies has added to the growing concern that science and biomedicine may be in the midst of a "reproducibility crisis." Against this backdrop, high-capacity machine learning models are beginning to demonstrate early successes in clinical applications,3 and some have received approval from the US Food and Drug Administration. This new class of clinical prediction tools presents unique challenges and obstacles to reproducibility, which must be carefully considered to ensure that these techniques are valid and deployed safely and effectively.


5 Reasons to Learn H2O for High-Performance Machine Learning

#artificialintelligence

H2O is the scalable, open-source Machine Learning library that features AutoML. Here are 5 Reasons why it's an essential library for creating production data science code. Before I jump into H2O, let's first understand the demand for ML. The 5-year trends in Technology Job Postings show a 440% increase in "Machine Learning" skills being requested, capturing a 7% share in all technology-related job postings. We can safely say that if you are in a technology job (or seeking one) then you need to learn how to apply AI and Machine Learning to solve business problems.


Artificial intelligence can help doctors diagnose life-threatening diseases: Here are five examples - Firstpost

#artificialintelligence

Case in point: recently, a team of researchers at the University of California Los Angeles (UCLA) developed an AI model that was better at differentiating between "preinvasive lesions of the breast" -- abnormal growths in breast cells -- than doctors with years of experience. They published their findings in the JAMA Network Open, a science journal, on 9 August. Machine learning is the capacity of a machine to learn from its mistakes, just like people do. Machines are also able to compute and assess different scenarios much faster, and more accurately than people. Incorrect breast cancer diagnoses are still quite common, leading to anxiety and depression in women.


Towards detection and classification of microscopic foraminifera using transfer learning

arXiv.org Machine Learning

Foraminifera are single-celled marine organisms, which may have a planktic or benthic lifestyle. During their life cycle they construct shells consisting of one or more chambers, and these shells remain as fossils in marine sediments. Classifying and counting these fossils have become an important tool in e.g. oceanography and climatology. Currently the process of identifying and counting microfossils is performed manually using a microscope and is very time consuming. Developing methods to automate this process is therefore considered important across a range of research fields. The first steps towards developing a deep learning model that can detect and classify microscopic foraminifera are proposed. The proposed model is based on a VGG16 model that has been pretrained on the ImageNet dataset, and adapted to the foraminifera task using transfer learning. Additionally, a novel image dataset consisting of microscopic foraminifera and sediments from the Barents Sea region is introduced.


Noisy Machines: Understanding Noisy Neural Networks and Enhancing Robustness to Analog Hardware Errors Using Distillation

arXiv.org Artificial Intelligence

A BSTRACT The success of deep learning has brought forth a wave of interest in computer hardware design to better meet the high demands of neural network inference. In particular, analog computing hardware has been heavily motivated specifically for accelerating neural networks, based on either electronic, optical or photonic devices, which may well achieve lower power consumption than conventional digital electronics. However, these proposed analog accelerators suffer from the intrinsic noise generated by their physical components, which makes it challenging to achieve high accuracy on deep neural networks. Hence, for successful deployment on analog accelerators, it is essential to be able to train deep neural networks to be robust to random continuous noise in the network weights, which is a somewhat new challenge in machine learning. In this paper, we advance the understanding of noisy neural networks. We outline how a noisy neural network has reduced learning capacity as a result of loss of mutual information between its input and output. To combat this, we propose using knowledge distillation combined with noise injection during training to achieve more noise robust networks, which is demonstrated experimentally across different networks and datasets, including ImageNet. Our method achieves models with as much as 2 greater noise tolerance compared with the previous best attempts, which is a significant step towards making analog hardware practical for deep learning. However, DNN inference is typically very demanding in terms of compute and memory resources Li et al. (2019). Consequently, larger models are often not well suited for large-scale deployment on edge devices, which typically have meagre performance and power budgets, especially battery powered mobile and IoT devices. To address these issues, the design of specialized hardware for DNN inference has drawn great interest, and is an extremely active area of research (Whatmough et al., 2019). To date, a plethora of techniques have been proposed for designing efficient neural network hardware (Sze et al., 2017; Whatmough et al., 2019).