Deep Learning
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Chen, Yiqiang, Wang, Jindong, Yu, Chaohui, Gao, Wen, Qin, Xin
With the rapid development of computing technology, wearable devices such as smart phones and wristbands make it easy to get access to people's health information including activities, sleep, sports, etc. Smart healthcare achieves great success by training machine learning models on a large quantity of user data. However, there are two critical challenges. Firstly, user data often exists in the form of isolated islands, making it difficult to perform aggregation without compromising privacy security. Secondly, the models trained on the cloud fail on personalization. In this paper, we propose FedHealth, the first federated transfer learning framework for wearable healthcare to tackle these challenges. FedHealth performs data aggregation through federated learning, and then builds personalized models by transfer learning. It is able to achieve accurate and personalized healthcare without compromising privacy and security. Experiments demonstrate that FedHealth produces higher accuracy (5.3% improvement) for wearable activity recognition when compared to traditional methods. FedHealth is general and extensible and has the potential to be used in many healthcare applications.
Building Better Deep Learning Requires New Approaches Not Just Bigger Data
In its rush to solve all the world's problems through deep learning, Silicon Valley is increasingly embracing the idea of AI as a universal solver that can be rapidly adapted to any problem in any domain simply by taking a stock algorithm and feeding it relevant training data. The problem with this assumption is that today's deep learning systems are little more than correlative pattern extractors that search large datasets for basic patterns and encode them into software. While impressive compared to the standards of previous eras, these systems are still extraordinarily limited, capable only of identifying simplistic correlations rather than actually semantically understanding their problem domain. In turn, the hand-coded era's focus on domain expertise, ethnographic codification and deeply understanding a problem domain has given way to parachute programming in which deep learning specialists take an off-the-shelf algorithm, shove in a pile of training data, dump out the resulting model and move on to the next problem. Truly advancing the state of deep learning and way in which companies make use of it will require a return to the previous era's focus on understanding problems rather than merely churning canned models off assembly lines.
Digging Deep into the Deepfake Appeal - OxGadgets
The term Deepfake itself is a combination of'Deep Learning' and'Fake'. Belonging to the larger body of Machine Learning, Deep Learning depends on artificial neural networks to process raw information. Deepfake is AI-dependent technology which is used to create or modify video that implies false situations. This term first came into being back in 2017. That is when a Reddit user (called deepfakes) began applying deep learning technology to swap celebrity faces onto people performing in pornographic videos.
BI 041 Brad Aimone: Neurogenesis and Spiking in Deep Nets
In this first part of our discussion, Brad and I discuss the state of neuromorphics and its relation to neuroscience and artificial intelligence. He describes his work adding new neurons to deep learning networks during training, called neurogenesis deep learning, inspired by how neurogenesis in the dentate gyrus of the hippocampus helps learn new things while keeping previous memories intact. We also talk about his method to transform deep learning networks into spiking neural networks so they can run on neuromorphic hardware, and the neuromorphics workshop he puts on every year, the Neuro Inspired Computational Elements (NICE) workshop.
How to Develop an Information Maximizing GAN (InfoGAN) in Keras
Taken from the InfoGan paper. Let's start off by developing the generator model as a deep convolutional neural network (e.g. a DCGAN). The model could take the noise vector (z) and control vector (c) as separate inputs and concatenate them before using them as the basis for generating the image. Alternately, the vectors can be concatenated beforehand and provided to a single input layer in the model. The approaches are equivalent and we will use the latter in this case to keep the model simple.
Gigatron: A pure bleeding edge monorepo for enterprise machine learning development
The data science can be defined as the convergence of Computer Science, programming, mathematical modeling, data analytics, academic expertise, traditional AI research, and applying the statistical techniques through scientific programming tools such as Python, R, TensorFlow, Java, on an ecosystem of SQL, NoSQL, GraphDB, streaming computing platforms such as Apache Spark, Apache Kafka, Apache Storm, Apache Nifi, Apache Flink, Apache Geode, and linked data to extract new knowledge discovery through data patterns and provide new insights from distributed computing platform from the tsunami of big data. Though, many times it is possible to define the statistical language models, it's difficult to implement through object-oriented programming languages. Therefore, it is critical to wear the hats of an advanced programmer, infrastructure architect to provide web scale performance with in-memory computing and apply traditional research with machine learning and deep learning algorithms to create novel architectures unique to each enterprise and avoid one-size fits all approach. Real-time analysis is all the rage in the data science industry. Therefore, leveraging in-memory computing ecosystems can provide faster execution results to the corporations.
Visualizing convolutional neural networks
Check out the full program at the TensorFlow World Conference, October 28-31, 2019. Best price ends August 2. Attention readers: We invite you to access the corresponding Python code and iPython notebooks for this article on GitHub. Given all of the higher level tools that you can use with TensorFlow, such as tf.contrib.learn But often with these higher level applications, you cannot access the little inbetween bits of the code, and some of the understanding of what's happening under the surface is lost. In this tutorial, I'll walk you through how to build a convolutional neural network from scratch, using just the low-level TensorFlow and visualizing our graph and network performance using TensorBoard. If you don't understand some of the basics of a fully connected neural network, I highly recommend you first check out Not another MNIST tutorial with TensorFlow.
Paige touts paper in Nature Medicine on AI for pathology
Pathology artificial intelligence (AI) software developer Paige is highlighting a paper published July 15 in Nature Medicine that indicates the company's technology can be used to develop AI algorithms with "near-perfect accuracy" for analyzing pathology slides for prostate cancer, skin cancer, and breast cancer. In the paper, Chief Scientific Officer Thomas Fuchs, PhD, of Memorial Sloan Kettering Cancer Center and colleagues describe how a series of deep-learning algorithms for clinical decision support in pathology were developed with an automated training and testing technique. Fuchs is the senior author on the paper, with his student Gabriele Campanella as the first author. The deployment of clinical decision support for pathology has been hindered by the need to curate large, manually annotated datasets to test and train AI algorithms, the authors noted. Instead, Campanella et al present a system in which algorithms are trained using only the reported diagnoses.
Deep Learning to Assess Long-term Mortality From Chest Radiographs
Question Is a convolutional neural network able to extract prognostic information from chest radiographs? Findings In this prognostic study of data from 2 randomized clinical trials (Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial [n 10 464] and National Lung Screening Trial [n 5493]), a convolutional neural network identified persons at high risk of long-term mortality based on their chest radiographs, even with adjustment for the radiologists' diagnostic findings and standard risk factors. Meaning Individuals at high risk of mortality based on chest radiography may benefit from prevention, screening, and lifestyle interventions. Importance Chest radiography is the most common diagnostic imaging test in medicine and may also provide information about longevity and prognosis. Objective To develop and test a convolutional neural network (CNN) (named CXR-risk) to predict long-term mortality, including noncancer death, from chest radiographs. Design, Setting, and Participants In this prognostic study, CXR-risk CNN development (n 41 856) and testing (n 10 464) used data from the screening radiography arm of the Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial (PLCO) (n 52 320), a community cohort of asymptomatic nonsmokers and smokers (aged 55-74 years) enrolled at 10 US sites from November 8, 1993, through July 2, 2001. External testing used data from the screening radiography arm of the National Lung Screening Trial (NLST) (n 5493), a community cohort of heavy smokers (aged 55-74 years) enrolled at 21 US sites from August 2002, through April 2004. Data analysis was performed from January 1, 2018, to May 23, 2019. Exposure Deep learning CXR-risk score (very low, low, moderate, high, and very high) based on CNN analysis of the enrollment radiograph.
DeepMind games--machine intelligence's next move
THE CHILD chess prodigy who created a computer that outplays human grandmasters--Demis Hassabis, founder of DeepMind--explains how games are a testing ground for algorithms and what real-world challenges he hopes to tackle with artificial intelligence. And, what can AlphaZero, the game-playing computer, teach human players? Kenneth Cukier also speaks to chess players Natasha Regan and Matthew Sadler, the authors of "Game Changer" on AlphaZero's chess strategy, as well as the chess historian Dominic Lawson about the future of machine intelligence and its interplay with human wisdom. Upgrade your inbox and get our Daily Dispatch and Editor's Picks.