Deep Learning
Biomedical Image Analysis and Machine Learning - Calsoft Inc. Blog
Radiological sciences in the last ten years have advanced in a revolutionary manner, especially when it comes about medical imaging and computerized medical image processing. These techniques help in the understanding of the disease as well as initiation and evaluation of ongoing treatment. Apart from this, the dataset of these images is used in further analysis of such diseases occurring around the world as a whole. Heather Landi, a senior editor at Fierce Healthcare, writes in an article that IBM researchers estimate that medical images, as the largest and fastest-growing data source in the healthcare industry, account for at least 90 percent of all medical data. We can use a computer to process and manipulate the multidimensional digital images of psychological structures in order to visualize hidden characteristic diagnostic features that are very difficult or perhaps impossible to see using planer imaging methods.
Microsoft Forays Into AI Processors With Graphcore Chips In Azure Cloud
Microsoft integrated Graphcore's AI-powered chip with its Azure to become the first cloud provider that offers optimizations for AI applications. With this addition, any organisation who leverages the Microsoft Azure cloud platform will be AI-ready. However, Microsoft will initially offer Graphcore's intelligence processing unit (IPU) AI capabilities to organisations who are pushing the boundaries in machine learning. Graphcore and Microsoft were working hand in hand for a little over two years to innovate and develop systems for Azure that could render ML tasks on IPUs. And this week, Microsoft announced the integration of the IPU with Azure to boost processing of artificial intelligence-based applications, thereby, evoking excitement among developers and businesses around the world.
Twitter round-up: AI trends in November 2019
Verdict lists ten of the most popular tweets on artificial intelligence (AI) in November 2019, based on data from GlobalData's Influencer Platform. The top tweets were chosen from influencers as tracked by GlobalData's Influencer Platform, which is based on a scientific process that works on pre-defined parameters. Influencers are selected after a deep analysis of the influencer's relevance, network strength, engagement, and leading discussions on new and emerging trends. Vala Afshar, Chief Digital Evangelist at Salesforce, shared a video of an interview of Bill Gates at a talk show hosted by David Letterman in 1995. Bill Gates tries to explain the internet to Letterman in the video.
Protect your Deep Neural Network by Embedding Watermarks!
We have intellectual property (IP) protection watermarks on media contents such as images, musics and etc. A watermark is like an identity given to your media content, e.g. This is to identify that the content is made by you and people who use your content should pay you some money. We can apply the same to DNN since the improvement of DNN is going to improve every year and a lot of companies start using DNN in their businesses. Lets say you have invested a lot of resources (e.g.
Neural Network Based Explicit MPC for Chemical Reactor Control
In this paper, we show the implementation of deep neural networks applied in process control. In our approach, we based the training of the neural network on model predictive control. Model predictive control is popular for its ability to be tuned by the weighting matrices and by the fact that it respects the constraints. We present the neural network that can approximate the behavior of the MPC in the way of mimicking the control input trajectory while the constraints on states and control input remain unimpaired of the value of the weighting matrices. This approach is demonstrated in a simulation case study involving a continuous stirred tank reactor, where multi-component chemical reaction takes place.
Transfer Learning-Based Outdoor Position Recovery with Telco Data
Zhang, Yige, Ding, Aaron Yi, Ott, Jorg, Yuan, Mingxuan, Zeng, Jia, Zhang, Kun, Rao, Weixiong
Telecommunication (Telco) outdoor position recovery aims to localize outdoor mobile devices by leveraging measurement report (MR) data. Unfortunately, Telco position recovery requires sufficient amount of MR samples across different areas and suffers from high data collection cost. For an area with scarce MR samples, it is hard to achieve good accuracy. In this paper, by leveraging the recently developed transfer learning techniques, we design a novel Telco position recovery framework, called TLoc, to transfer good models in the carefully selected source domains (those fine-grained small subareas) to a target one which originally suffers from poor localization accuracy. Specifically, TLoc introduces three dedicated components: 1) a new coordinate space to divide an area of interest into smaller domains, 2) a similarity measurement to select best source domains, and 3) an adaptation of an existing transfer learning approach. To the best of our knowledge, TLoc is the first framework that demonstrates the efficacy of applying transfer learning in the Telco outdoor position recovery. To exemplify, on the 2G GSM and 4G LTE MR datasets in Shanghai, TLoc outperforms a nontransfer approach by 27.58% and 26.12% less median errors, and further leads to 47.77% and 49.22% less median errors than a recent fingerprinting approach NBL.
Deep Latent Factor Model for Collaborative Filtering
Mongia, Aanchal, Jhamb, Neha, Chouzenoux, Emilie, Majumdar, Angshul
Latent factor models have been used widely in collaborative filtering based recommender systems. In recent years, deep learning has been successful in solving a wide variety of machine learning problems. Motivated by the success of deep learning, we propose a deeper version of latent factor model. Experiments on benchmark datasets shows that our proposed technique significantly outperforms all state-of-the-art collaborative filtering techniques.
Encoding Musical Style with Transformer Autoencoders
Choi, Kristy, Hawthorne, Curtis, Simon, Ian, Dinculescu, Monica, Engel, Jesse
A BSTRACT We consider the problem of learning high-level controls over the global structure of sequence generation, particularly in the context of symbolic music generation with complex language models. In this work, we present the Transformer au-toencoder, which aggregates encodings of the input data across time to obtain a global representation of style from a given performance. We show it is possible to combine this global embedding with other temporally distributed embeddings, enabling improved control over the separate aspects of performance style and and melody. Empirically, we demonstrate the effectiveness of our method on a variety of music generation tasks on the MAESTRO dataset and a Y ouTube dataset with 10,000 hours of piano performances, where we achieve improvements in terms of log-likelihood and mean listening scores as compared to relevant baselines. As the number of generative applications increase, it becomes increasingly important to consider how users can interact with such systems, particularly when the generative model functions as a tool in their creative process (Engel et al., 2017a; Gillick et al., 2019) To this end, we consider how one can learn high-level controls over the global structure of a generated sample. We focus on symbolic music generation, where Music Transformer (Huang et al., 2019b) is the current state-of-the-art in generating high-quality samples that span over a minute in length. The challenge in controllable sequence generation is that Transformers (V aswani et al., 2017) and their variants excel as language models or in sequence-to-sequence tasks such as translation, but it is less clear as to how they can: (1) learn and (2) incorporate global conditioning information at inference time. This contrasts with traditional generative models for images such as the variational autoencoder (V AE) (Kingma & Welling, 2013) or generative adversarial network (GAN) (Goodfel-low et al., 2014) which can incorporate global conditioning (e.g.
Deep One-bit Compressive Autoencoding
Khobahi, Shahin, Bose, Arindam, Soltanalian, Mojtaba
Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely data-driven approaches do not need explicit mathematical models for data generation and have a wider applicability at the cost of interpretability. In this paper, we consider the design of a one-bit compressive autoencoder, and propose a novel hybrid model-based and data-driven methodology that allows us to not only design the sensing matrix for one-bit data acquisition, but also allows for learning the latent-parameters of an iterative optimization algorithm specifically designed for the problem of one-bit sparse signal recovery. Our results demonstrate a significant improvement compared to state-of-the-art model-based algorithms.
Neural Memory Networks for Robust Classification of Seizure Type
Ahmedt-Aristizabal, David, Fernando, Tharindu, Denman, Simon, Petersson, Lars, Aburn, Matthew J., Fookes, Clinton
Classification of seizure type is a key step in the clinical process for evaluating an individual who presents with seizures. It determines the course of clinical diagnosis and treatment, and its impact stretches beyond the clinical domain to epilepsy research and the development of novel therapies. Automated identification of seizure type may facilitate understanding of the disease, and seizure detection and prediction has been the focus of recent research that has sought to exploit the benefits of machine learning and deep learning architectures. Nevertheless, there is not yet a definitive solution for automating the classification of seizure type, a task that must currently be performed by an expert epileptologist. Inspired by recent advances in neural memory networks (NMNs), we introduce a novel approach for the classification of seizure type using electrophysiological data. We first explore the performance of traditional deep learning techniques which use convolutional and recurrent neural networks, and enhance these architectures by using external memory modules with trainable neural plasticity. We show that our model achieves a state-of-the-art weighted F1 score of 0.945 for seizure type classification on the TUH EEG Seizure Corpus with the IBM TUSZ preprocessed data. This work highlights the potential of neural memory networks to support the field of epilepsy research, along with biomedical research and signal analysis more broadly.