Goto

Collaborating Authors

 Deep Learning


A Survey on Face Data Augmentation

arXiv.org Artificial Intelligence

The quality and size of training set have great impact on the results of deep learning-based face related tasks. However, collecting and labeling adequate samples with high quality and balanced distributions still remains a laborious and expensive work, and various data augmentation techniques have thus been widely used to enrich the training dataset. In this paper, we systematically review the existing works of face data augmentation from the perspectives of the transformation types and methods, with the state-of-the-art approaches involved. Among all these approaches, we put the emphasis on the deep learning-based works, especially the generative adversarial networks which have been recognized as more powerful and effective tools in recent years. We present their principles, discuss the results and show their applications as well as limitations. Different evaluation metrics for evaluating these approaches are also introduced. We point out the challenges and opportunities in the field of face data augmentation, and provide brief yet insightful discussions.


Dogs vs Cats is too easy

#artificialintelligence

The Dogs vs Cats problem has become a sort of hello world for deep learning folks. Many courses and blog posts that are aimed at beginners use it as the fundamental building block for an introduction into the exciting world of deep learning. Fastai has not been any different with past versions of the course focusing on building a Dogs vs Cats classifier in the first lesson. So the Dogs vs Cats problem is no longer challenging which means there is no opportunity to try out new ideas. A more challenging problem that Jeremy suggests is fine-grain classification.


Where is AI Used the Most? In Cybersecurity

#artificialintelligence

The use of AI is increasing across a multitude of functionalities, but according to data provided by the Consumer Technology Association, its top use in 2018 was in cybersecurity: specifically in detecting and deterring security intrusions, with 44 percent of all AI applications being used for that purpose. Artificial intelligence is particularly attuned to performing and automating cybersecurity tasks by utilizing deep-learning algorithms to find patterns in data, detect vulnerable user behaviors, and predict security trends. Azure Sentinel, Microsoft's cloud-based SIEM (security information and event management) tool is one such example of an artificial intelligence that doesn't just automate security operations tasks but uses algorithms to learn from its actions. Like any AI, the more data it receives, the more accurate its decisions are in identifying threats and responding to them. Ultimately, the goal is for AI to be fully autonomous in its prediction, detection, and response to malicious threats, working behind the scenes and providing a seamless front-end-user experience.


Debunking The Myths And Reality Of Artificial Intelligence

#artificialintelligence

Intelligence should be "distributed" where "knowledge" is created and "decisions" are made A few years ago, it was hard to find anyone to have a serious discussion about Artificial Intelligence (AI) outside academic institutions. Like any new major technology trend, the new wave of making AI and intelligent systems a reality is creating curiosity and enthusiasm. People are jumping on its bandwagon adding not only great ideas but also in many cases a lot of false promises and sometimes misleading opinions. Built by giant thinkers and academic researchers, AI adoption by industries and further development in academia around the globe is progressing at a faster rate than anyone had excepted. Accelerated by the strong belief that our biological limitations are increasingly becoming a major obstacle towards creating smart systems and machines that work with us to better use our biological cognitive capabilities to achieve higher goals. This is driving an overwhelming wave of demands and investments across industries to apply AI technologies to solve real-world problems and create smarter machines and new businesses.


Machine Learning For Distributed Acoustic Sensors, Classic versus Image and Deep Neural Networks Approach

arXiv.org Machine Learning

Distributed Acoustic Sensing (DAS) using fiber optic cables is a promising new technology for pipeline monitoring and protection. In this work, we applied and compared two approaches for event detection using DAS: Classic machine learning approach and the approach based on image processing and deep learning. Although with both approaches acceptable performance can be achieved, the preliminary results show that image based deep learning is more promising approach, offering six times lower event detection delay and twelve times lower execution time.


A data-driven proxy to Stoke's flow in porous media

arXiv.org Machine Learning

The objective for this work is to develop a data-driven proxy to high-fidelity numerical flow simulations using digital images. The proposed model can capture the flow field and permeability in a large verity of digital porous media based on solid grain geometry and pore size distribution by detailed analyses of the local pore geometry and the local flow fields. To develop the model, the detailed pore space geometry and simulation runs data from 3500 two-dimensional high-fidelity Lattice Boltzmann simulation runs are used to train and to predict the solutions with a high accuracy in much less computational time. The proposed methodology harness the enormous amount of generated data from high-fidelity flow simulations to decode the often under-utilized patterns in simulations and to accurately predict solutions to new cases. The developed model can truly capture the physics of the problem and enhance prediction capabilities of the simulations at a much lower cost. These predictive models, in essence, do not spatio-temporally reduce the order of the problem. They, however, possess the same numerical resolutions as their Lattice Boltzmann simulations equivalents do with the great advantage that their solutions can be achieved by significant reduction in computational costs (speed and memory).


Bayesian Generative Active Deep Learning

arXiv.org Machine Learning

Deep learning models have demonstrated outstanding performance in several problems, but their training process tends to require immense amounts of computational and human resources for training and labeling, constraining the types of problems that can be tackled. Therefore, the design of effective training methods that require small labeled training sets is an important research direction that will allow a more effective use of resources.Among current approaches designed to address this issue, two are particularly interesting: data augmentation and active learning. Data augmentation achieves this goal by artificially generating new training points, while active learning relies on the selection of the "most informative" subset of unlabeled training samples to be labelled by an oracle. Although successful in practice, data augmentation can waste computational resources because it indiscriminately generates samples that are not guaranteed to be informative, and active learning selects a small subset of informative samples (from a large un-annotated set) that may be insufficient for the training process. In this paper, we propose a Bayesian generative active deep learning approach that combines active learning with data augmentation -- we provide theoretical and empirical evidence (MNIST, CIFAR-$\{10,100\}$, and SVHN) that our approach has more efficient training and better classification results than data augmentation and active learning.


Attention-based Transfer Learning for Brain-computer Interface

arXiv.org Artificial Intelligence

Different functional areas of the human brain play different roles in brain activity, which has not been paid sufficient research attention in the brain-computer interface (BCI) field. This paper presents a new approach for electroencephalography (EEG) classification that applies attention-based transfer learning. Our approach considers the importance of different brain functional areas to improve the accuracy of EEG classification, and provides an additional way to automatically identify brain functional areas associated with new activities without the involvement of a medical professional. We demonstrate empirically that our approach out-performs state-of-the-art approaches in the task of EEG classification, and the results of visualization indicate that our approach can detect brain functional areas related to a certain task.


Importance of Copying Mechanism for News Headline Generation

arXiv.org Artificial Intelligence

News headline generation is an essential problem of text summarization because it is constrained, well-defined, and is still hard to solve. Models with a limited vocabulary can not solve it well, as new named entities can appear regularly in the news and these entities often should be in the headline. News articles in morphologically rich languages such as Russian require model modifications due to a large number of possible word forms. This study aims to validate that models with a possibility of copying words from the original article performs better than models without such an option. The proposed model achieves a mean ROUGE score of 23 on the provided test dataset, which is 8 points greater than the result of a similar model without a copying mechanism. Moreover, the resulting model performs better than any known model on the new dataset of Russian news.


The Mutex Watershed and its Objective: Efficient, Parameter-Free Image Partitioning

arXiv.org Machine Learning

Image partitioning, or segmentation without semantics, is the task of decomposing an image into distinct segments, or equivalently to detect closed contours. Most prior work either requires seeds, one per segment; or a threshold; or formulates the task as multicut / correlation clustering, an NP-hard problem. Here, we propose a greedy algorithm for signed graph partitioning, the "Mutex Watershed". Unlike seeded watershed, the algorithm can accommodate not only attractive but also repulsive cues, allowing it to find a previously unspecified number of segments without the need for explicit seeds or a tunable threshold. We also prove that this simple algorithm solves to global optimality an objective function that is intimately related to the multicut / correlation clustering integer linear programming formulation. The algorithm is deterministic, very simple to implement, and has empirically linearithmic complexity. When presented with short-range attractive and long-range repulsive cues from a deep neural network, the Mutex Watershed gives the best results currently known for the competitive ISBI 2012 EM segmentation benchmark.