Deep Learning
Interview with Nick Payton, B2B Marketing Leader at SigOpt
As teams apply optimization earlier and more frequently in the modeling process, they develop high-performing models at a faster pace. This virtuous cycle increases the number of models that make it into production, which amplifies the impact of these models on the business. At the Deep Learning Summit in San Francisco, SigOpt will be showcasing their model optimization software and how they automate model tuning to accelerate the model development process and amplify the impact of models in production at scale. We spoke to Nick Payton, B2B Marketing Lead at SigOpt to learn more. SigOpt's mission is to empower experts.
Creating machines that understand language is AI's next big challenge
About halfway through a particularly tense game of Go held in Seoul, South Korea, between Lee Sedol, one of the best players of all time, and AlphaGo, an artificial intelligence created by Google, the AI program made a mysterious move that demonstrated an unnerving edge over its human opponent. On move 37, AlphaGo chose to put a black stone in what seemed, at first, like a ridiculous position. It looked certain to give up substantial territory--a rookie mistake in a game that is all about controlling the space on the board. Two television commentators wondered if they had misread the move or if the machine had malfunctioned somehow. In fact, contrary to any conventional wisdom, move 37 would enable AlphaGo to build a formidable foundation in the center of the board. The Google program had effectively won the game using a move that no human would've come up with. AlphaGo's victory is particularly impressive because the ancient game of Go is often looked at as a test of intuitive intelligence. The rules are quite simple. Two players take turns putting black or white stones at the intersection of horizontal and vertical lines on a board, trying to surround their opponent's pieces and remove them from play.
Artificial intelligence and deep learning in ophthalmology
Funding This project received funding from the National Medical Research Council (NMRC), Ministry of Health (MOH), Singapore National Health Innovation Center, Innovation to Develop Grant (NHIC-I2D-1409022), SingHealth Foundation Research Grant (SHF/FG648S/2015), and the Tanoto Foundation, and unrestricted donations to the Retina Division, Johns Hopkins University School of Medicine. PAK is supported by a UK National Institute for Health Research (NIHR) Clinician Scientist Award (NIHR-CS--2014-12-023). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
Why Machine Learning Needs Semantics Not Just Statistics
The deep learning revolution has ushered in a new generation of machine learning tools capable of identifying the patterns in massive noisy datasets with accuracy that often exceeds that of human domain experts. In turn, as machines have achieved human or even superhuman accuracy across an increasing number of tasks, we have increasingly described them in the same terms we describe ourselves, as silicon incarnations of life, learning about the world. Yet, a critical distinction between machines and humans is the way in which we reason about the world: humans through high order semantic abstractions and machines through blind adherence to statistics. The problem with likening machine learning to human learning is that when humans learn, they connect the patterns they identify to high order semantic abstractions of the underlying objects and activities. In turn, our background knowledge and experiences give us the necessary context to reason about those patterns and identify the ones most likely to represent robust actionable knowledge.
r/MachineLearning - [D] Best practices for running deep learning experiments on the cloud
I'm working on a machine translation research project, and appealing to the wisdom of the masses here to hopefully improve my workflow. I'm looking for recommendations on workflow optimization and cloud provider tools (I want to avoid buying a GPU specifically for this task) for my project. I know which deep learning framework to use (and what other python libraries, so not looking for recommendations in that area). The data is large-ish -- too large for Git but not large enough for Hadoop. I'm anticipating many experiment variations, where hyper parameters as well as pre-processing of the data may change between experiments.
Designing neural networks through neuroevolution
Much of recent machine learning has focused on deep learning, in which neural network weights are trained through variants of stochastic gradient descent. An alternative approach comes from the field of neuroevolution, which harnesses evolutionary algorithms to optimize neural networks, inspired by the fact that natural brains themselves are the products of an evolutionary process. Neuroevolution enables important capabilities that are typically unavailable to gradient-based approaches, including learning neural network building blocks (for example activation functions), hyperparameters, architectures and even the algorithms for learning themselves. Neuroevolution also differs from deep learning (and deep reinforcement learning) by maintaining a population of solutions during search, enabling extreme exploration and massive parallelization. Finally, because neuroevolution research has (until recently) developed largely in isolation from gradient-based neural network research, it has developed many unique and effective techniques that should be effective in other machine learning areas too.
Deep Learning: Perturbations and Diversity is All You Need
A generating process can conjure up sufficient complexity that cannot be predicted using the bulk statistics that is observed. The algorithm to conjure up this deceptive distribution is very simple. Take an an existing dataset, perturb it slightly, and continue to maintain specific statistical properties. This is done by randomly selecting a point, add a small perturbation and then validating if the statistics are within targeted bounds. Now repeat these perturbation enough times and you can target different results.
Practical Deep Learning with PyTorch
Although many courses are very mathematical or too practical in nature, this course strikes a careful balance between the two to provide a solid foundation in deep learning for you to explore further if you are interested in research in the field of deep learning and/or applied deep learning. It is purposefully made for anyone without a strong background in mathematics. And for those with a strong background, it would accelerate your learning in understanding the different models in deep learning. This entire course is delivered in a Python Notebook such that you can follow along the videos and replicate the results. You can practice and tweak the models until you truly understand every line of code as we go along.