Deep Learning
Towards Knowledgeable Supervised Lifelong Learning Systems
Benavides-Prado, Diana (The University of Auckland) | Koh, Yun Sing | Riddle, Patricia
Learning a sequence of tasks is a long-standing challenge in machine learning. This setting applies to learning systems that observe examples of a range of tasks at different points in time. A learning system should become more knowledgeable as more related tasks are learned. Although the problem of learning sequentially was acknowledged for the first time decades ago, the research in this area has been rather limited. Research in transfer learning, multitask learning, metalearning and deep learning has studied some challenges of these kinds of systems. Recent research in lifelong machine learning and continual learning has revived interest in this problem. We propose Proficiente, a full framework for long-term learning systems. Proficiente relies on knowledge transferred between hypotheses learned with Support Vector Machines. The first component of the framework is focused on transferring forward selectively from a set of existing hypotheses or functions representing knowledge acquired during previous tasks to a new target task. A second component of Proficiente is focused on transferring backward, a novel ability of long-term learning systems that aim to exploit knowledge derived from recent tasks to encourage refinement of existing knowledge. We propose a method that transfers selectively from a task learned recently to existing hypotheses representing previous tasks. The method encourages retention of existing knowledge whilst refining. We analyse the theoretical properties of the proposed framework. Proficiente is accompanied by an agnostic metric that can be used to determine if a long-term learning system is becoming more knowledgeable. We evaluate Proficiente in both synthetic and real-world datasets, and demonstrate scenarios where knowledgeable supervised learning systems can be achieved by means of transfer.
Automated Classification of Radiographic Knee Osteoarthritis Severity Using Deep Neural Networks
To develop an automated model for staging knee osteoarthritis severity from radiographs and to compare its performance to that of musculoskeletal radiologists. Radiographs from the Osteoarthritis Initiative staged by a radiologist committee using the Kellgren-Lawrence (KL) system were used. Before using the images as input to a convolutional neural network model, they were standardized and augmented automatically. The model was trained with 32 116 images, tuned with 4074 images, evaluated with a 4090-image test set, and compared to two individual radiologists using a 50-image test subset. Saliency maps were generated to reveal features used by the model to determine KL grades.
MathWorks Delivers Additional AI Capabilities With Release 2020a of MATLAB and Simulink
MathWorks today introduced Release 2020a with expanded AI capabilities for deep learning. Engineers can now train neural networks in the updated Deep Network Designer app, manage multiple deep learning experiments in a new Experiment Manager app, and choose from more network options to generate deep learning code. R2020a introduces new capabilities specifically for automotive and wireless engineers in addition to hundreds of new and updated features for all users of MATLAB and Simulink. More details are available in the Release 2020a video. "MathWorks provides a comprehensive platform for building AI-driven systems," said David Rich, MATLAB marketing director.
Telstra throws deep learning at its network challenges
Telstra is running deep learning algorithms over its Networks data to predict equipment failures before they occur and to find ways to address voice and SMS scams. Data science (Networks) team manager Tim Osborne revealed the project, which is codenamed Telstra AI Lab or TAIL, in a presentation to IBM's Think 2020 conference overnight. TAIL is operating on a still-evolving applied data science platform pieced together with IBM's assistance. It uses a mix of existing Cisco UCS C240s and new IBM Power System AC922s for compute, and a Kubernetes-based stack on top, including Kubeflow, which is used to run machine learning algorithms on Kubernetes. Osborne said TAIL was supported by a team of 25 data scientists and date engineers, who worked "with network engineering folks end-to-end across the business, looking to solve some of their most challenging problems with data science."
Human Activity Recognition with OpenCV and Deep Learning - PyImageSearch
In this tutorial you will learn how to perform Human Activity Recognition with OpenCV and Deep Learning. Our human activity recognition model can recognize over 400 activities with 78.4-94.5% accuracy (depending on the task). To learn how to perform human activity recognition with OpenCV and Deep Learning, just keep reading! In the first part of this tutorial we'll discuss the Kinetics dataset, the dataset used to train our human activity recognition model. From there we'll discuss how we can extend ResNet, which typically uses 2D kernels, to instead leverage 3D kernels, enabling us to include a spatiotemporal component used for activity recognition.
A Foolproof Way to Shrink Deep Learning Models
Researchers have proposed a technique for shrinking deep learning models that they say is simpler and produces more accurate results than state-of-the-art methods. Massachusetts Institute of Technology (MIT) researchers have proposed a technique for compressing deep learning models, by retraining a smaller model whose weakest connections have been "pruned," at its faster, initial rate of learning. The technique's groundwork was partly laid by the AutoML for model compression (AMC) algorithm from MIT's Song Han, which automatically removes redundant neurons and connections, and retrains the model to reinstate its initial accuracy. MIT's Jonathan Frankle and Michael Carbin determined that the model could simply be rewound to its early training rate without tinkering with any parameters. Although greater shrinkage is accompanied by reduced model accuracy, in comparing their method to AMC or earlier work by Frankle on weight-rewinding techniques, Frankle and Carbin found that it performed better regardless of the amount of compression.
Artificial Intelligence is Evolving to Process the World Like Humans
As engineers and researchers work on developing and perfecting their machine learning and AI algorithms, the end goal is ultimately to recreate the human brain. The most perfect AI imaginable would be able to process the world around us through typical sensory input but leverage the storage and computing strengths of supercomputers. With that end goal in mind, it's not hard to understand the ways that AI is evolving as it continues to be developed. Deep learning AI is able to interpret patterns and derive conclusions. In essence, it's learning how to mimic the way that humans process the world around us. That said, from the onset, AIs generally need typical computer input, like coded data.