Goto

Collaborating Authors

 Inductive Learning


Semi-supervised learning

arXiv.org Machine Learning

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of not classified data, to perform classification, in situations when, typically, the labelled data are few. Even though this is not always possible (it depends on how useful is to know the distribution of the unlabelled data in the inference of the labels), several algorithm have been proposed recently. A new algorithm is proposed, that under almost neccesary conditions, attains asymptotically the performance of the best theoretical rule, when the size of unlabeled data tends to infinity. The set of necessary assumptions, although reasonables, show that semi-parametric classification only works for very well conditioned problems.


Supervised learning in disguise: the truth about unsupervised learning - Data Points

#artificialintelligence

One of the first lessons you'll receive in machine learning is that there are two broad categories: supervised and unsupervised learning. Supervised learning is usually explained as the one to which you provide the correct answers, training data, and the machine learns the patterns to apply to new data. Unsupervised learning is (apparently) where the machine figures out the correct answer on its own. Supposedly, unsupervised learning can discover something new that has not been found in the data before. Supervised learning cannot do that. It's true that there are two classes of machine learning algorithm, and each is applied to different types of problems, but is unsupervised learning really free of supervision?


Top 10 Machine Learning Algorithms for Beginners

#artificialintelligence

The study of ML algorithms has gained immense traction post the Harvard Business Review articleterming a'Data Scientist' as the'Sexiest job of the 21st century'. So, for those starting out in the field of ML, we decided to do a reboot of our immensely popular Gold blog The 10 Algorithms Machine Learning Engineers need to know - albeit this post is targetted towards beginners. ML algorithms are those that can learn from data and improve from experience, without human intervention. Learning tasks may include learning the function that maps the input to the output, learning the hidden structure in unlabeled data; or'instance-based learning', where a class label is produced for a new instance by comparing the new instance (row) to instances from the training data, which were stored in memory. 'Instance-based learning' does not create an abstraction from specific instances. Supervised learning can be explained as follows: use labeled training data to learn the mapping function from the input variables (X) to the output variable (Y). Examples include labels such as male and female, sick and healthy.


9 ways Machine Learning can Improve your Business

@machinelearnbot

There's a number of ways you could be using Machine Learning in your business. To manage your ML projects efficiently and have them deliver real value to your business, you should have a good overview of what ML can help you with and how. I've listed 9 things, but let's first go back to some business fundamentals to see how this list is structuredโ€ฆ Better businesses serve more customers, they serve them better, and in a more efficient way. How well they're doing that can be measured with revenue and costs, or simply with revenue-costs profit. ML can help in these 3 areas through the use of "supervised" learning techniques.


Virtual Adversarial Ladder Networks For Semi-supervised Learning

arXiv.org Machine Learning

Semi-supervised learning (SSL) partially circumvents the high cost of labeling data by augmenting a small labeled dataset with a large and relatively cheap unlabeled dataset drawn from the same distribution. This paper offers a novel interpretation of two deep learning-based SSL approaches, ladder networks and virtual adversarial training (VAT), as applying distributional smoothing to their respective latent spaces. We propose a class of models that fuse these approaches. We achieve near-supervised accuracy with high consistency on the MNIST dataset using just 5 labels per class: our best model, ladder with layer-wise virtual adversarial noise (LVAN-LW), achieves 1.42% +/- 0.12 average error rate on the MNIST test set, in comparison with 1.62% +/- 0.65 reported for the ladder network. On adversarial examples generated with L2-normalized fast gradient method, LVAN-LW trained with 5 examples per class achieves average error rate 2.4% +/- 0.3 compared to 68.6% +/- 6.5 for the ladder network and 9.9% +/- 7.5 for VAT.


Modular Continual Learning in a Unified Visual Environment

arXiv.org Machine Learning

A core aspect of human intelligence is the ability to learn new tasks quickly and switch between them flexibly. Here, we describe a modular continual reinforcement learning paradigm inspired by these abilities. We first introduce a visual interaction environment that allows many types of tasks to be unified in a single framework. We then describe a reward map prediction scheme that learns new tasks robustly in the very large state and action spaces required by such an environment. We investigate how properties of module architecture influence efficiency of task learning, showing that a module motif incorporating specific design principles (e.g. early bottlenecks, low-order polynomial nonlinearities, and symmetry) significantly outperforms more standard neural network motifs, needing fewer training examples and fewer neurons to achieve high levels of performance. Finally, we present a meta-controller architecture for task switching based on a dynamic neural voting scheme, which allows new modules to use information learned from previously-seen tasks to substantially improve their own learning efficiency.


Behind the boom in machine learning

#artificialintelligence

How machine learning has grown since NIPS' start in the '80s: "Over that period what happened was a convergence of a number of different factors, one of them being the fact that computers got a million times faster. Back then we could only study little toy networks with a few hundred units. But now we can study networks with millions of units. The other thing was the training sets -- you need to have examples of what it is you're trying to learn. The internet made it possible for us to get millions of training examples relatively easily, because there's so many images, abundant speech examples, and so forth, that you can download from the internet. Finally, there were breakthroughs along the way in the algorithms that we used to make them more efficient. We understood them a lot better in terms of something called regularization, which is how to keep the network from memorizing -- you want it to generalize."


Semi-supervised Learning with GANs: Manifold Invariance with Improved Inference

arXiv.org Machine Learning

Semi-supervised learning methods using Generative adversarial networks (GANs) have shown promising empirical success recently. Most of these methods use a shared discriminator/classifier which discriminates real examples from fake while also predicting the class label. Motivated by the ability of the GANs generator to capture the data manifold well, we propose to estimate the tangent space to the data manifold using GANs and employ it to inject invariances into the classifier. In the process, we propose enhancements over existing methods for learning the inverse mapping (i.e., the encoder) which greatly improves in terms of semantic similarity of the reconstructed sample with the input sample. We observe considerable empirical gains in semi-supervised learning over baselines, particularly in the cases when the number of labeled examples is low. We also provide insights into how fake examples influence the semi-supervised learning procedure.


Doctor Tied to Sen. Menendez Case Set for Fraud Sentencing

U.S. News

A three-day sentencing hearing for Dr. Salomon Melgen is scheduled to begin Tuesday in West Palm Beach on 67 counts. Prosecutors say the 63-year-old doctor stole more than $100 million from the federal government. He was convicted in April after a 2 1/2- month trial.


Supreme Court Ruling in McDonnell Case Sets Louisiana Congressman William Jefferson Free

U.S. News

Not long after Jefferson was put behind bars, another political corruption case blossomed, this time around Virginia Gov. Robert McDonnell and his wife, Maureen. The McDonnells reportedly accepted more than $175,000 in loans and gifts from a local businessman in return for his exposure to state officials and industry leaders. McDonnell and his wife were indicted and convicted after the governor left office in January 2014.