Deep Learning
How Deep Learning AI Will Shape Asset Management
Everyone today talks about AI, big data and machine learning, yet most do not delve into the fundamental properties of how they will operate and how they might be an actual threat to asset managers. Some view technological methods as tools to assist them instead of being such a threat, and it would help provide both perspectives of the argument. Deep learning is a branch of machine learning that uses particular architectures of neural networks. These are artificial networks that attempt to actually replicate how the neural structures in human brains operate. Such methods have successfully been applied to areas such as computer vision โ i.e. image processing and classification โ as well as speech recognition. The techniques are readily available to any undergraduate student willing to learn the process.
The machine that's learning to mimic your brain
Poggio, who is also a primary investigator at MIT's McGovern Institute for Brain Research, is the senior author on a paper describing the new work, which appeared today in the journal Computational Biology. He's joined on the paper by several other members of both the CBMM and the McGovern Institute: first author Joel Leibo, a researcher at Google DeepMind, who earned his PhD in brain and cognitive sciences from MIT with Poggio as his advisor; Qianli Liao, an MIT graduate student in electrical engineering and computer science; Fabio Anselmi, a postdoc in the IIT@MIT Laboratory for Computational and Statistical Learning, a joint venture of MIT and the Italian Institute of Technology; and Winrich Freiwald, an associate professor at the Rockefeller University.
Real world AI in business
Many companies are already planning or implementing AI projects as part of their ongoing digital transformation strategy. H2O.ai are focused on helping companies harness the power of their data by bringing AI to the mainstream through software innovation and creating an Apple-like experience for data scientists. Its enviable customer roster includes multinationals like Capital One, Cisco and PricewaterhouseCoopers, all relying on H2O.ai to help them make better predictions, deliver ready to use algorithms and put big data to work. It's flagship open source platform, H2O is the positioned as the leading machine learning prediction engine for Spark and Hadoop workloads. "Vertical is the new horizontal. Our largest customers are transforming their businesses with data and AI and nurturing their communities with beautiful data products. Visual experience and the interpretation of AI is crucial for further democratizing algorithms and making them easily accessible," said H2O.ai CEO Sri Ambati.
A Practical Introduction to Deep Learning with Caffe and Python // Adil Moujahid // Data Analytics and more
Deep learning is the new big trend in machine learning. It had many recent successes in computer vision, automatic speech recognition and natural language processing. The goal of this blog post is to give you a hands-on introduction to deep learning. To do this, we will build a Cat/Dog image classifier using a deep learning algorithm called convolutional neural network (CNN) and a Kaggle dataset. This post is divided into 2 main parts. The first part covers some core concepts behind deep learning, while the second part is structured in a hands-on tutorial format. In the first part of the hands-on tutorial (section 4), we will build a Cat/Dog image classifier using a convolutional neural network from scratch.
Decoding the human brain
CHENNAI: Google DeepMind's AlphaGo, an artificial intelligence programme developed using deep neural networks and machine learning techniques, hit global headlines last year when it beat South Korean Go grandmaster Lee Sedol to win the series 4-1. However, not many know that AlphaGo has consumed a whopping 30,000 watts of power to complete the task, while the human brain consumes around 20 watts! What gives the human brain such efficiency has so far proven elusive to replicate in computers. Not surprisingly, man's most defining organ is also the least understood. Although an adult human brain weighing 1.4 kg is made up of close to 100 billion neurons, scientists do not know how many different kinds of human neurons exist.
Finding Career Opportunities in AI
Summary: Are there large, sustainable career opportunities in AI and if so where? Do they lie in the current technologies of Deep Learning and Reinforcement Learning or should you focus your career on the next wave of AI? If you're a data scientist thinking about expanding your career options into AI you've got a forest and trees problem. There's a lot going on in deep learning and reinforcement learning but do these areas hold the best future job prospects or do we need to be looking a little further forward? To try to answer that question we'll have to get out of the weeds of current development and get a higher level perspective about where this is all headed. The roots of AI are actually in the behavioral sciences migrating eventually into biology and neurology.
Data Programming: Creating Large Training Sets, Quickly
Ratner, Alexander, De Sa, Christopher, Wu, Sen, Selsam, Daniel, Rรฉ, Christopher
Large labeled training sets are the critical building blocks of supervised learning methods and are key enablers of deep learning techniques. For some applications, creating labeled training sets is the most time-consuming and expensive part of applying machine learning. We therefore propose a paradigm for the programmatic creation of training sets called data programming in which users express weak supervision strategies or domain heuristics as labeling functions, which are programs that label subsets of the data, but that are noisy and may conflict. We show that by explicitly representing this training set labeling process as a generative model, we can "denoise" the generated training set, and establish theoretically that we can recover the parameters of these generative models in a handful of settings. We then show how to modify a discriminative loss function to make it noise-aware, and demonstrate our method over a range of discriminative models including logistic regression and LSTMs. Experimentally, on the 2014 TAC-KBP Slot Filling challenge, we show that data programming would have led to a new winning score, and also show that applying data programming to an LSTM model leads to a TAC-KBP score almost 6 F1 points over a state-of-the-art LSTM baseline (and into second place in the competition). Additionally, in initial user studies we observed that data programming may be an easier way for non-experts to create machine learning models when training data is limited or unavailable.
Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
Kamnitsas, Konstantinos, Ledig, Christian, Newcombe, Virginia F. J., Simpson, Joanna P., Kane, Andrew D., Menon, David K., Rueckert, Daniel, Glocker, Ben
We propose a dual pathway, 11-layers deep, three-dimensional Convolutional Neural Network for the challenging task of brain lesion segmentation. The devised architecture is the result of an in-depth analysis of the limitations of current networks proposed for similar applications. To overcome the computational burden of processing 3D medical scans, we have devised an efficient and effective dense training scheme which joins the processing of adjacent image patches into one pass through the network while automatically adapting to the inherent class imbalance present in the data. Further, we analyze the development of deeper, thus more discriminative 3D CNNs. In order to incorporate both local and larger contextual information, we employ a dual pathway architecture that processes the input images at multiple scales simultaneously. For post-processing of the network's soft segmentation, we use a 3D fully connected Conditional Random Field which effectively removes false positives. Our pipeline is extensively evaluated on three challenging tasks of lesion segmentation in multi-channel MRI patient data with traumatic brain injuries, brain tumors, and ischemic stroke. We improve on the state-of-the-art for all three applications, with top ranking performance on the public benchmarks BRATS 2015 and ISLES 2015. Our method is computationally efficient, which allows its adoption in a variety of research and clinical settings. The source code of our implementation is made publicly available.
Deep Learning with Python [Video] PACKT Books
Deep learning is currently one of the best providers of solutions regarding problems in image recognition, speech recognition, object recognition, and natural language with its increasing number of libraries that are available in Python. The aim of deep learning is to develop deep neural networks by increasing and improving the number of training layers for each network, so that a machine learns more about the data until it's as accurate as possible. Developers can avail the techniques provided by deep learning to accomplish complex machine learning tasks, and train AI networks to develop deep levels of perceptual recognition. Deep learning is the next step to machine learning with a more advanced implementation. Currently, it's not established as an industry standard, but is heading in that direction and brings a strong promise of being a game changer when dealing with raw unstructured data.
What's Inside the "Black Box" of Machine Learning? - RTInsights
Machine learning can optimize business decisions, but the decision reached by an algorithm often isn't transparent. The list of possibilities is endless. Machine learning applications "can provide customer service, manage logistics, analyze medical records, or even write news stories," a recent report by McKinsey Global Institute explains. The McKinsey report identified 120 potential use cases and interviewed 600 industry experts on the potential impact of machine learning. As machines take on routinized decision-making processes, "the value potential is everywhere, even in industries that have been slow to digitize," the report's authors explain.