Deep Learning
Valohai Brings AI to GitHub
We had the opportunity to meet with Eero Laaksonen, CEO of as part of the IT Press Tour in San Francisco. Valoh is the Finnish word for lantern shark, a deep-dwelling, self-illuminating fish. Eero believes automation is key to improving quality of life and that deep learning makes things that are not scalable today, scalable like looking at medical images and autonomous cars. Valohai strives to push all industries forward with the ability to do meaningful things faster.
Artificial intelligence better than humans at spotting lung cancer
Researchers have used a deep-learning algorithm to detect lung cancer accurately from computed tomography scans. The results of the study indicate that artificial intelligence can outperform human evaluation of these scans. The condition is the leading cause of cancer-related death in the U.S., and early detection is crucial for both stopping the spread of tumors and improving patient outcomes. As an alternative to chest X-rays, healthcare professionals have recently been using computed tomography (CT) scans to screen for lung cancer. In fact, some scientists argue that CT scans are superior to X-rays for lung cancer detection, and research has shown that low-dose CT (LDCT) in particular has reduced lung cancer deaths by 20%.
Detecting and classifying lesions in mammograms with Deep Learning
In the last two decades, Computer Aided Detection (CAD) systems were developed to help radiologists analyse screening mammograms, however benefits of current CAD technologies appear to be contradictory, therefore they should be improved to be ultimately considered useful. Since 2012, deep convolutional neural networks (CNN) have been a tremendous success in image recognition, reaching human performance. These methods have greatly surpassed the traditional approaches, which are similar to currently used CAD solutions. Deep CNN-s have the potential to revolutionize medical image analysis. We propose a CAD system based on one of the most successful object detection frameworks, Faster R-CNN.
Pathology AI Algorithms Deployed on Augmented Reality Microscope in Preclinical Study
Life sciences Artificial Intelligence products and services company, AIRA Matrix ("AIRA Matrix"), and microscope-based digital pathology platform Augmentiqs ("Augmentiqs"), announced the world's first pre-clinical deployment of deep-learning algorithms in an augmented reality microscope. The partnership between AIRA Matrix and Augmentiqs will allow pathologists to deploy deep-learning AI algorithms directly in their existing microscope. AIRA Matrix and Augmentiqs partnered together to deploy Artificial Intelligence ("AI") based pathology algorithms directly within the microscope. In this deployment, the deep learning solution for fatty liver and myopathy tissue samples highlighted and quantified the region of interest as the slide was on the microscope stage, with results presented in real-time to the pathologist as augmented reality within the microscope eyepiece. A Japanese organization sponsored the pre-clinical study, which took place at Integrated Laboratory Systems ("ILS"), a North Carolina Contract Research Organization.
Neural networks for option pricing and hedging: a literature review
This work provides a review of this literature. The motivation for this summary arose from our companion paper Ruf and W ang [2019]. There we continue th e discussions of this note; in particular, of potentially problematic data leakage when training ANNs to historic financial data. This paper is organised in the following way. Section 2 featu res Table 1, a summary of the literature that concerns the use of ANNs for nonparametric pricing (and hedging) of options. Section 3 provides a list of recommended papers from Table 1. Section 4 provides a n overview of related work where ANNs are applied in the context of option pricing and hedging, but not necessarily as nonparametric estimation tools. Section 5 briefly discusses various regularisation techniq ues used in the reviewed literature.
AMPL: A Data-Driven Modeling Pipeline for Drug Discovery
Minnich, Amanda J., McLoughlin, Kevin, Tse, Margaret, Deng, Jason, Weber, Andrew, Murad, Neha, Madej, Benjamin D., Ramsundar, Bharath, Rush, Tom, Calad-Thomson, Stacie, Brase, Jim, Allen, Jonathan E.
One of the key requirements for incorporating machine learning into the drug discovery process is complete reproducibility and traceability of the model building and evaluation process. With this in mind, we have developed an end-to-end modular and extensible software pipeline for building and sharing machine learning models that predict key pharma-relevant parameters. The ATOM Modeling PipeLine, or AMPL, extends the functionality of the open source library DeepChem and supports an array of machine learning and molecular featurization tools. We have benchmarked AMPL on a large collection of pharmaceutical datasets covering a wide range of parameters. As a result of these comprehensive experiments, we have found that physicochemical descriptors and deep learning-based graph representations significantly outperform traditional fingerprints in the characterization of molecular features. We have also found that dataset size is directly correlated to prediction performance, and that single-task deep learning models only outperform shallow learners if there is sufficient data. Likewise, dataset size has a direct impact on model predictivity, independent of comprehensive hyperparameter model tuning. Our findings point to the need for public dataset integration or multi-task/transfer learning approaches. Lastly, we found that uncertainty quantification (UQ) analysis may help identify model error; however, efficacy of UQ to filter predictions varies considerably between datasets and featurization/model types. AMPL is open source and available for download at http://github.com/ATOMconsortium/AMPL.
Meta-Learning with Dynamic-Memory-Based Prototypical Network for Few-Shot Event Detection
Deng, Shumin, Zhang, Ningyu, Kang, Jiaojian, Zhang, Yichi, Zhang, Wei, Chen, Huajun
Event detection (ED), a sub-task of event extraction, involves identifying triggers and categorizing event mentions. Existing methods primarily rely upon supervised learning and require large-scale labeled event datasets which are unfortunately not readily available in many real-life applications. In this paper, we consider and reformulate the ED task with limited labeled data as a Few-Shot Learning problem. We propose a Dynamic-Memory-Based Prototypical Network (DMB-PN), which exploits Dynamic Memory Network (DMN) to not only learn better prototypes for event types, but also produce more robust sentence encodings for event mentions. Differing from vanilla prototypical networks simply computing event prototypes by averaging, which only consume event mentions once, our model is more robust and is capable of distilling contextual information from event mentions for multiple times due to the multi-hop mechanism of DMNs. The experiments show that DMB-PN not only deals with sample scarcity better than a series of baseline models but also performs more robustly when the variety of event types is relatively large and the instance quantity is extremely small.
Medi-Care AI: Predicting Medications From Billing Codes via Robust Recurrent Neural Networks
In this paper, we present an effective deep prediction framework based on robust recurrent neural networks (RNNs) to predict the likely therapeutic classes of medications a patient is taking, given a sequence of diagnostic billing codes in their record. Accurately capturing the list of medications currently taken by a given patient is extremely challenging due to undefined errors and omissions. We present a general robust framework that explicitly models the possible contamination through overtime decay mechanism on the input billing codes and noise injection into the recurrent hidden states, respectively. By doing this, billing codes are reformulated into its temporal patterns with decay rates on each medical variable, and the hidden states of RNNs are regularised by random noises which serve as dropout to improved RNNs robustness towards data variability in terms of missing values and multiple errors. The proposed method is extensively evaluated on real health care data to demonstrate its effectiveness in suggesting medication orders from contaminated values.
TASTE: Temporal and Static Tensor Factorization for Phenotyping Electronic Health Records
Afshar, Ardavan, Perros, Ioakeim, Park, Haesun, deFilippi, Christopher, Yan, Xiaowei, Stewart, Walter, Ho, Joyce, Sun, Jimeng
Phenotyping electronic health records (EHR) focuses on defining meaningful patient groups (e.g., heart failure group and diabetes group) and identifying the temporal evolution of patients in those groups. Tensor factorization has been an effective tool for phenotyping. Most of the existing works assume either a static patient representation with aggregate data or only model temporal data. However, real EHR data contain both temporal (e.g., longitudinal clinical visits) and static information (e.g., patient demographics), which are difficult to model simultaneously. In this paper, we propose Temporal And Static TEnsor factorization (TASTE) that jointly models both static and temporal information to extract phenotypes. TASTE combines the PARAFAC2 model with non-negative matrix factorization to model a temporal and a static tensor. To fit the proposed model, we transform the original problem into simpler ones which are optimally solved in an alternating fashion. For each of the sub-problems, our proposed mathematical reformulations lead to efficient sub-problem solvers. Comprehensive experiments on large EHR data from a heart failure (HF) study confirmed that TASTE is up to 14x faster than several baselines and the resulting phenotypes were confirmed to be clinically meaningful by a cardiologist. Using 80 phenotypes extracted by TASTE, a simple logistic regression can achieve the same level of area under the curve (AUC) for HF prediction compared to a deep learning model using recurrent neural networks (RNN) with 345 features.