Goto

Collaborating Authors

 Deep Learning


The Common Misconceptions About Machine Learning - KDnuggets

#artificialintelligence

There is a hype train going on about ML (Machine Learning), and many beginners are getting to be the victims of this hype train as they are getting in for the wrong reasons. Your professor will explain how getting a Ph.D. is necessary if you want to get better or your peers are telling you how to get a better GPU and IDE (Integrated Development Environment). When you started to learn from the online courses, you realized you needed a bigger dataset and proficiency in Python. After learning the required skills when you applied for a job, you realized that you need more than a few courses or certifications to make it. In the end, after getting the job, you realized that it is demanding work, and sometimes these jobs don't pay well at the initial stages. This article will help you get through these disappointments and prepare you to face these problems.


Difference between Artificial Intelligence, Machine Learning, Deep Learning, and Data Science

#artificialintelligence

Machine learning enables a machine to automatically learn from data, improve performance from experiences, and predict things without being explicitly programmed. Deep learning algorithms attempt to draw similar conclusions as humans would by continually analyzing data with a given logical structure. Q-learning is a model-free reinforcement learning algorithm to learn the value of an action in a particular state. It does not require a model of the environment, and it can handle problems with stochastic transitions and rewards without requiring adaptations. This field of engineering focuses on the design and manufacturing of robots.


Bring Your Own Container With Amazon SageMaker

#artificialintelligence

In the past I've talked about how to train a custom TensorFlow model on Amazon SageMaker. This is made easy because SageMaker manages containers for popular frameworks such as TensorFlow, PyTorch, HuggingFace, and more. This allows for developers to use these provided containers and focus on providing a Script for training and/or inference in a method known as Script Mode. Now let's say the framework you're working with is not supported by SageMaker's existing Deep Learning containers. This is a real possibility as there's many existing ML frameworks that are being launched with every coming week.


The Rise of Digital Humans

#artificialintelligence

A few years back, it was difficult to imagine a world in which we can interact with digital humans on a daily basis. But as of today, you can encounter a digital human as a part of a layered digital fabric integrated into a website's customer support bot or in a game you are playing. You will only realize the intensity of the artificial human interaction if you are unable to distinguish the bot from a real human. If any of these three types compete for the level of an actual human, then that is because of a great execution of an ultra-high-quality, real-time rendered model that would bring life to the data. The approach for creating such kind of bot can be a lot of manual and scripted animation (incl motion capture) and months of character artistry Or it can be a single Deep Learning model, that does the same thing in a fraction of a second.


The Complete Machine Learning Course with Python

#artificialintelligence

Machine Learning Engineers earn on average $166,000 - become an ideal candidate with this course! Machine Learning Engineers earn on average $166,000 - become an ideal candidate with this course! The Complete Machine Learning Course in Python has been FULLY UPDATED for November 2019! With brand new sections as well as updated and improved content, you get everything you need to master Machine Learning in one course! Foundations of Deep Learning covering topics such as the difference between classical programming and machine learning, differentiate between machine and deep learning, the building blocks of neural networks, descriptions of tensor and tensor operations, categories of machine learning and advanced concepts such as over- and underfitting, regularization, dropout, validation and testing and much more.


Metric-based multimodal meta-learning for human movement identification via footstep recognition

arXiv.org Artificial Intelligence

We describe a novel metric-based learning approach that introduces a multimodal framework and uses deep audio and geophone encoders in siamese configuration to design an adaptable and lightweight supervised model. This framework eliminates the need for expensive data labeling procedures and learns general-purpose representations from low multisensory data obtained from omnipresent sensing systems. These sensing systems provide numerous applications and various use cases in activity recognition tasks. Here, we intend to explore the human footstep movements from indoor environments and analyze representations from a small self-collected dataset of acoustic and vibration-based sensors. The core idea is to learn plausible similarities between two sensory traits and combining representations from audio and geophone signals. We present a generalized framework to learn embeddings from temporal and spatial features extracted from audio and geophone signals. We then extract the representations in a shared space to maximize the learning of a compatibility function between acoustic and geophone features. This, in turn, can be used effectively to carry out a classification task from the learned model, as demonstrated by assigning high similarity to the pairs with a human footstep movement and lower similarity to pairs containing no footstep movement. Performance analyses show that our proposed multimodal framework achieves a 19.99\% accuracy increase (in absolute terms) and avoided overfitting on the evaluation set when the training samples were increased from 200 pairs to just 500 pairs while satisfactorily learning the audio and geophone representations. Our results employ a metric-based contrastive learning approach for multi-sensor data to mitigate the impact of data scarcity and perform human movement identification with limited data size.


Solving Linear Algebra by Program Synthesis

arXiv.org Artificial Intelligence

We solve MIT's Linear Algebra 18.06 course and Columbia University's Computational Linear Algebra COMS3251 courses with perfect accuracy by interactive program synthesis. This surprisingly strong result is achieved by turning the course questions into programming tasks and then running the programs to produce the correct answers. We use OpenAI Codex with zero-shot learning, without providing any examples in the prompts, to synthesize code from questions. We quantify the difference between the original question text and the transformed question text that yields a correct answer. Since all COMS3251 questions are not available online the model is not overfitting. We go beyond just generating code for questions with numerical answers by interactively generating code that also results visually pleasing plots as output. Finally, we automatically generate new questions given a few sample questions which may be used as new course content. This work is a significant step forward in solving quantitative math problems and opens the door for solving many university level STEM courses by machine.


Triggerless Backdoor Attack for NLP Tasks with Clean Labels

arXiv.org Artificial Intelligence

Backdoor attacks pose a new threat to NLP models. A standard strategy to construct poisoned data in backdoor attacks is to insert triggers (e.g., rare words) into selected sentences and alter the original label to a target label. This strategy comes with a severe flaw of being easily detected from both the trigger and the label perspectives: the trigger injected, which is usually a rare word, leads to an abnormal natural language expression, and thus can be easily detected by a defense model; the changed target label leads the example to be mistakenly labeled and thus can be easily detected by manual inspections. To deal with this issue, in this paper, we propose a new strategy to perform textual backdoor attacks which do not require an external trigger, and the poisoned samples are correctly labeled. The core idea of the proposed strategy is to construct clean-labeled examples, whose labels are correct but can lead to test label changes when fused with the training set. To generate poisoned clean-labeled examples, we propose a sentence generation model based on the genetic algorithm to cater to the non-differentiable characteristic of text data. Extensive experiments demonstrate that the proposed attacking strategy is not only effective, but more importantly, hard to defend due to its triggerless and clean-labeled nature. Our work marks the first step towards developing triggerless attacking strategies in NLP.


AnimeCeleb: Large-Scale Animation CelebFaces Dataset via Controllable 3D Synthetic Models

arXiv.org Artificial Intelligence

Despite remarkable success in deep learning-based face-related models, these models are still limited to the domain of real human faces. On the other hand, the domain of animation faces has been studied less intensively due to the absence of a well-organized dataset. In this paper, we present a large-scale animation celebfaces dataset (AnimeCeleb) via controllable synthetic animation models to boost research on the animation face domain. To facilitate the data generation process, we build a semi-automatic pipeline based on an open 3D software and a developed annotation system. This leads to constructing a large-scale animation face dataset that includes multi-pose and multi-style animation faces with rich annotations. Experiments suggest that our dataset is applicable to various animation-related tasks such as head reenactment and colorization.


Solving Inverse Problems in Medical Imaging with Score-Based Generative Models

arXiv.org Machine Learning

Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing solutions based on machine learning typically train a model to directly map measurements to medical images, leveraging a training dataset of paired images and measurements. These measurements are typically synthesized from images using a fixed physical model of the measurement process, which hinders the generalization capability of models to unknown measurement processes. To address this issue, we propose a fully unsupervised technique for inverse problem solving, leveraging the recently introduced score-based generative models. Specifically, we first train a score-based generative model on medical images to capture their prior distribution. Given measurements and a physical model of the measurement process at test time, we introduce a sampling method to reconstruct an image consistent with both the prior and the observed measurements. Our method does not assume a fixed measurement process during training, and can thus be flexibly adapted to different measurement processes at test time. Empirically, we observe comparable or better performance to supervised learning techniques in several medical imaging tasks in CT and MRI, while demonstrating significantly better generalization to unknown measurement processes. Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) are commonly used imaging tools for medical diagnosis. Reconstructing CT and MRI images from raw measurements (sinograms for CT and k-spaces for MRI) are well-known inverse problems. Specifically, measurements in CT are given by X-ray projections of an object from various directions, and measurements in MRI are obtained by inspecting the Fourier spectrum of an object with magnetic fields.