Goto

Collaborating Authors

 Deep Learning


Stochastic Subset Selection

arXiv.org Machine Learning

Current machine learning algorithms are designed to work with huge volumes of high dimensional data such as images. However, these algorithms are being increasingly deployed to resource constrained systems such as mobile devices and embedded systems. Even in cases where large computing infrastructure is available, the size of each data instance, as well as datasets, can provide a huge bottleneck in data transfer across communication channels. Also, there is a huge incentive both in energy and monetary terms in reducing both the computational and memory requirements of these algorithms. For non-parametric models that require to leverage the stored training data at the inference time, the increased cost in memory and computation could be even more problematic. In this work, we aim to reduce the volume of data these algorithms must process through an end-to-end two-stage neural subset selection model, where the first stage selects a set of candidate points using a conditionally independent Bernoulli mask followed by an iterative coreset selection via a conditional Categorical distribution. The subset selection model is trained by meta-learning with a distribution of sets. We validate our method on set reconstruction and classification tasks with feature selection as well as the selection of representative samples from a given dataset, on which our method outperforms relevant baselines. We also show in our experiments that our method enhances scalability of non-parametric models such as Neural Processes.


A framework for probabilistic weather forecast post-processing across models and lead times using machine learning

arXiv.org Machine Learning

Forecasting the weather is an increasingly data intensive exercise. Numerical Weather Prediction (NWP) models are becoming more complex, with higher resolutions, and there are increasing numbers of different models in operation. While the forecasting skill of NWP models continues to improve, the number and complexity of these models poses a new challenge for the operational meteorologist: how should the information from all available models, each with their own unique biases and limitations, be combined in order to provide stakeholders with well-calibrated probabilistic forecasts to use in decision making? In this paper, we use a road surface temperature example to demonstrate a three-stage framework that uses machine learning to bridge the gap between sets of separate forecasts from NWP models and the 'ideal' forecast for decision support: probabilities of future weather outcomes. First, we use Quantile Regression Forests to learn the error profile of each numerical model, and use these to apply empirically-derived probability distributions to forecasts. Second, we combine these probabilistic forecasts using quantile averaging. Third, we interpolate between the aggregate quantiles in order to generate a full predictive distribution, which we demonstrate has properties suitable for decision support. Our results suggest that this approach provides an effective and operationally viable framework for the cohesive post-processing of weather forecasts across multiple models and lead times to produce a well-calibrated probabilistic output.


Deep Learning on Point Clouds for False Positive Reduction at Nodule Detection in Chest CT Scans

arXiv.org Machine Learning

This paper focuses on a novel approach for false-positive reduction (FPR) of nodule candidates in Computer-aided detection (CADe) systems following the suspicious lesions detection stage. Contrary to typical decisions in medical image analysis, the proposed approach considers input data not as a 2D or 3D image, but rather as a point cloud, and uses deep learning models for point clouds. We discovered that point cloud models require less memory and are faster both in training and inference compared to traditional CNN 3D, they achieve better performance and do not impose restrictions on the size of the input image, i.e. no restrictions on the size of the nodule candidate. We propose an algorithm for transforming 3D CT scan data to point cloud. In some cases, the volume of the nodule candidate can be much smaller than the surrounding context, for example, in the case of subpleural localization of the nodule. Therefore, we developed an algorithm for sampling points from a point cloud constructed from a 3D image of the candidate region. The algorithm is able to guarantee the capture of both context and candidate information as part of the point cloud of the nodule candidate. We designed and set up an experiment in creating a dataset from an open LIDC-IDRI database for a feature of the FPR task, and is herein described in detail. Data augmentation was applied both to avoid overfitting and as an upsampling method. Experiments were conducted with PointNet, PointNet++, and DGCNN. We show that the proposed approach outperforms baseline CNN 3D models and resulted in 85.98 FROC versus 77.26 FROC for baseline models. We compare our algorithm with published SOTA and demonstrate that even without significant modifications it works at the appropriate performance level on LUNA2016 and shows SOTA on LIDC-IDRI.


What I learned from looking at 200 machine learning tools

#artificialintelligence

To better understand the landscape of available tools for machine learning production, I decided to look up every AI/ML tool I could find. After filtering out applications companies (e.g. companies that use ML to provide business analytics), tools that aren't being actively developed, and tools that nobody uses, I got 202 tools. Please let me know if there are tools you think I should include but aren't on the list yet! The landscape is under-developed IV. I categorize the tools based on which step of the workflow that it supports.


A16Z AI Playbook

#artificialintelligence

There are AI areas focused on different senses, but vision is fundamental along with natural language. Vision attempts to identify and extract symbols from raw visual data and then use those symbols to make decisions, take actions or produce information. These symbols have many forms: they can be labels from a set used for training, captions, text extracted from the image via OCR, colors, and so on. Not all images are created alike: In general, systems that are good at processing attributes for still images are not necessarily as good for processing video, and vice-versa. Sub-domains of computer vision include scene reconstruction, motion/event detection, tracking, object recognition, and image restoration among many others.


Artificial Intelligence vs. Machine Learning vs. Deep Learning: What's the Difference

#artificialintelligence

In 2020, people benefit from artificial intelligence every day: music recommender systems, Google maps, Uber, and many more applications are powered with AI. One of popular Google search requests goes as follows: "are artificial intelligence and machine learning the same thing?". Let's clear things up: artificial intelligence (AI), machine learning (ML), and deep learning (DL) are three different things. The term artificial intelligence was first used in 1956, at a computer science conference in Dartmouth. AI described an attempt to model how the human brain works and, based on this knowledge, create more advanced computers. The scientists expected that to understand how the human mind works and digitalize it shouldn't take too long.


A deep-learning E-skin decodes complex human motion

#artificialintelligence

Conventional approaches require many sensor networks that cover the entire curvilinear surfaces of the target area. Unlike conventional wafer-based fabrication, this laser fabrication provides a new sensing paradigm for motion tracking. The research team, led by Professor Sungho Jo from the School of Computing, collaborated with Professor Seunghwan Ko from Seoul National University to design this new measuring system that extracts signals corresponding to multiple finger motions by generating cracks in metal nanoparticle films using laser technology. The sensor patch was then attached to a user's wrist to detect the movement of the fingers. The concept of this research started from the idea that pinpointing a single area would be more efficient for identifying movements than affixing sensors to every joint and muscle.


RNN and LSTM -- The Neural Networks with Memory

#artificialintelligence

As you read this article, you understand each word based on your understanding of previous words. You don't throw everything away and start thinking from scratch again. We have already seen in Introduction to Artificial Neural Networks(ANN) how ANN can be used for regression and classification tasks, and in Introduction to Convolutional Neural Networks(CNN) how CNN can be used for image recognition, segmentation or object detection and computer-vision related tasks. But what if we have sequential data? Before we dig into details of Recurrent Neural networks, if you are a beginner I suggest you read below two articles to get a basic understanding of neural networks.


Council Post: Facial Recognition Systems Security

#artificialintelligence

Facial recognition systems can be considered a controversial technology. On the one hand, this technology affects people's privacy. On the other hand, it assists in preventing or detecting violence. And now, in light of the global pandemic, it helps to deter the spread of coronavirus. Nonetheless, like any other technology, facial recognition isn't impeccable, but has vulnerabilities that make it possible to bypass a system.


Is Deep Learning hitting the wall?

#artificialintelligence

We own a full exclusive full license to this photo.. In the world of the rising numbers of Machine Learning (ML) related projects, simplified ML frameworks and environments, and prepackaged ML solutions in the cloud -- the voice of disappointment can be heard more and more often. This ever growing voice is coming from the top experts in the matter, so we at Avenga Tech would like to take a moment to share our opinion about whether deep learning is really hitting the wall. Is the current state of enterprise AI in need of another major breakthrough, or can we use current techniques and not worry? Avenga has extensive expertise in data science and deep learning in particular. So, here we are to help you understand the reasons and practical implications of the current situation. AI has improperly, but surely, become synonymous with Machine Learning, and machine learning is almost always related to deep learning (also false, because there are more techniques), and deep learning usually relates to Convolutional Neural Network (CNN, a type of artificial neural networks that learns how to recognize and classify the patterns in input data). For a given set of problems, usually pattern recognition, deep learning enables very high accuracy, relatively quick learning, and the fast and low resources model execution including mobile battery powered devices.