Deep Learning
An Ethical Application of Computer Vision and Deep Learning -- Identifying Child Soldiers Through Automatic Age and Military Fatigue Detection - PyImageSearch
In this tutorial, we will learn how to apply Computer Vision, Deep Learning, and OpenCV to identify potential child soldiers through automatic age detection and military fatigue recognition. Military service is something of personal importance to me, something I consider honorable and admirable. That's precisely the reason why this project, leveraging technology to identify child soldiers, is something I feel strongly about -- nobody should be forced to serve, and especially young children. You see, the military has always been a big part of my family growing up, even though I did not personally serve. Even outside my direct family, the military was still part of my life and community. I went to high school in a rural area of Maryland. If you didn't want to become a farmer or work in agriculture, that really only left two options -- go to college or join the military. If I'm recalling correctly, before I graduated from high school, at least 10 kids from my class enlisted, some of whom I knew personally and had classes with.
Defining "Vision" in "Computer Vision"
Computer Vision also referred as Vision is the recent cutting edge field within computer science that deals with enabling computers, devices or machines, in general, to see, understand, interpret or manipulate what is being seen. Computer Vision technology implements deep learning techniques and in few cases also employs Natural Language Processing techniques as a natural progression of steps to analyze extracted text from images. With all the advancements of deep learning, building functions like image classification, object detection, tracking, and image manipulation has become more simpler and accurate thus leading way to exploring more complex autonomous applications like self-driving cars, humanoids or drones. With deep learning, we can now manipulate images, for example superimpose Tom Cruise's features onto another face. Or convert a picture into a sketch mode or water color painting mode.
Understanding The Recognition Pattern Of AI
Of the seven patterns of AI that represent the ways in which AI is being implemented, one of the most common is the recognition pattern. The main idea of the recognition pattern of AI is that we're using machine learning and cognitive technology to help identify and categorize unstructured data into specific classifications. The unstructured data could be images, video, text, or even quantitative data. The power of this pattern is that we're enabling machines to do the thing that our brains seem to do so easily: identify what we're perceiving in the real world around us. The recognition pattern is notable in that it was primarily the attempts to solve image recognition challenges that brought about heightened interest in deep learning approaches to AI, and helped to kick off this latest wave of AI investment and interest.
Artificial Intelligence and music creation: What is OpenAI's Jukebox? Purple Sneakers
The future is now people. Not only do we have pandemic-proof rave suits being designed, we also now might be on the precipice of having music released made with Artificial Intelligence thanks to the latest development from OpenAI. Aptly titled'Jukebox', the new model is now able to generate genre-specific music. According to OpenAI's website, Jukebox is "a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artist styles." Using over 1.6million songs as their dataset, Jukebox is able to use a song provided as input, and generate a sample produced from scratch in specific genres as output.
Noise Homogenization via Multi-Channel Wavelet Filtering for High-Fidelity Sample Generation in GANs
In the generator of typical Generative Adversarial Networks (GANs), a noise is inputted to generate fake samples via a series of convolutional operations. However, current noise generation models merely relies on the information from the pixel space, which increases the difficulty to approach the target distribution. Fortunately, the long proven wavelet transformation is able to decompose multiple spectral information from the images. In this work, we propose a novel multi-channel wavelet-based filtering method for GANs, to cope with this problem. When embedding a wavelet deconvolution layer in the generator, the resultant GAN, called WaveletGAN, takes advantage of the wavelet deconvolution to learn a filtering with multiple channels, which can efficiently homogenize the generated noise via an averaging operation, so as to generate high-fidelity samples. We conducted benchmark experiments on the Fashion-MNIST, KMNIST and SVHN datasets through an open GAN benchmark tool. The results show that WaveletGAN has excellent performance in generating high-fidelity samples, thanks to the smallest FIDs obtained on these datasets.
A network-based transfer learning approach to improve sales forecasting of new products
Karb, Tristan, Kühl, Niklas, Hirt, Robin, Glivici-Cotruta, Varvara
Data-driven methods -- such as machine learning and time series forecasting -- are widely used for sales forecasting in the food retail domain. However, for newly introduced products insufficient training data is available to train accurate models. In this case, human expert systems are implemented to improve prediction performance. Human experts rely on their implicit and explicit domain knowledge and transfer knowledge about historical sales of similar products to forecast new product sales. By applying the concept of Transfer Learning, we propose an analytical approach to transfer knowledge between listed stock products and new products. A network-based Transfer Learning approach for deep neural networks is designed to investigate the efficiency of Transfer Learning in the domain of food sales forecasting. Furthermore, we examine how knowledge can be shared across different products and how to identify the products most suitable for transfer. To test the proposed approach, we conduct a comprehensive case study for a newly introduced product, based on data of an Austrian food retailing company. The experimental results show, that the prediction accuracy of deep neural networks for food sales forecasting can be effectively increased using the proposed approach.
Artificial Neural Network Pruning to Extract Knowledge
Artificial Neural Networks (NN) are widely used for solving complex problems from medical diagnostics to face recognition. Despite notable successes, the main disadvantages of NN are also well known: the risk of overfitting, lack of explainability (inability to extract algorithms from trained NN), and high consumption of computing resources. Determining the appropriate specific NN structure for each problem can help overcome these difficulties: Too poor NN cannot be successfully trained, but too rich NN gives unexplainable results and may have a high chance of overfitting. Reducing precision of NN parameters simplifies the implementation of these NN, saves computing resources, and makes the NN skills more transparent. This paper lists the basic NN simplification problems and controlled pruning procedures to solve these problems. All the described pruning procedures can be implemented in one framework. The developed procedures, in particular, find the optimal structure of NN for each task, measure the influence of each input signal and NN parameter, and provide a detailed verbal description of the algorithms and skills of NN. The described methods are illustrated by a simple example: the generation of explicit algorithms for predicting the results of the US presidential election.
Multiple Imputation for Biomedical Data using Monte Carlo Dropout Autoencoders
Miok, Kristian, Nguyen-Doan, Dong, Robnik-Šikonja, Marko, Zaharie, Daniela
Due to complex experimental settings, missing values are common in biomedical data. To handle this issue, many methods have been proposed, from ignoring incomplete instances to various data imputation approaches. With the recent rise of deep neural networks, the field of missing data imputation has oriented towards modelling of the data distribution. This paper presents an approach based on Monte Carlo dropout within (Variational) Autoencoders which offers not only very good adaptation to the distribution of the data but also allows generation of new data, adapted to each specific instance. The evaluation shows that the imputation error and predictive similarity can be improved with the proposed approach.
Implicit Regularization in Deep Learning May Not Be Explainable by Norms
Mathematically characterizing the implicit regularization induced by gradient-based optimization is a longstanding pursuit in the theory of deep learning. A widespread hope is that a characterization based on minimization of norms may apply, and a standard test-bed for studying this prospect is matrix factorization (matrix completion via linear neural networks). It is an open question whether norms can explain the implicit regularization in matrix factorization. The current paper resolves this open question in the negative, by proving that there exist natural matrix factorization problems on which the implicit regularization drives all norms (and quasi-norms) towards infinity. Our results suggest that, rather than perceiving the implicit regularization via norms, a potentially more useful interpretation is minimization of rank. We demonstrate empirically that this interpretation extends to a certain class of non-linear neural networks, and hypothesize that it may be key to explaining generalization in deep learning.