Goto

Collaborating Authors

 Learning Management


Adversarial Online Learning with noise

arXiv.org Machine Learning

We present and study models of adversarial online learning where the feedback observed by the learner is noisy, and the feedback is either full information feedback or bandit feedback. Specifically, we consider binary losses xored with the noise, which is a Bernoulli random variable. We consider both a constant noise rate and a variable noise rate. Our main results are tight regret bounds for learning with noise in the adversarial online learning model.



Generalized Inverse Optimization through Online Learning

arXiv.org Machine Learning

Inverse optimization is a powerful paradigm for learning preferences and restrictions that explain the behavior of a decision maker, based on a set of external signal and the corresponding decision pairs. However, most inverse optimization algorithms are designed specifically in batch setting, where all the data is available in advance. As a consequence, there has been rare use of these methods in an online setting suitable for real-time applications. In this paper, we propose a general framework for inverse optimization through online learning. Specifically, we develop an online learning algorithm that uses an implicit update rule which can handle noisy data. Moreover, under additional regularity assumptions in terms of the data and the model, we prove that our algorithm converges at a rate of $\mathcal{O}(1/\sqrt{T})$ and is statistically consistent. In our experiments, we show the online learning approach can learn the parameters with great accuracy and is very robust to noises, and achieves a dramatic improvement in computational efficacy over the batch learning approach.


Machine learning with Python: Essential hacks and tricks

#artificialintelligence

It's never been easier to get started with machine learning. In addition to structured massive open online courses (MOOCs), there are a huge number of incredible, free resources available around the web. Here are a few that have helped me. Familiarity and moderate expertise in at least one high-level programming language is useful for beginners in machine learning. Unless you are a Ph.D. researcher working on a purely theoretical proof of some complex algorithm, you are expected to mostly use the existing machine learning algorithms and apply them in solving novel problems. This requires you to put on a programming hat.


Online Learning Algorithms for Statistical Arbitrage

arXiv.org Machine Learning

Arbitrage is the risk-free method of making profit from exploiting price differences in different markets. For example, if one stock is trading at a higher price in one market than another, one could buy the stock for the lower price on one market and sell it for the higher price on the other, thereby making profit without taking risks. These pricing disparities have become increasingly hard to capitalize on as they only appear for very short periods of time with the advancements in technology and highfrequency trading. Only those who can recognize and take advantage of arbitrage opportunities first can benefit, turning it into a winner-takes-all situation. This has made it difficult to make consistent profit from price discrepancies, as one needs to recognize them quickly and be the first to leverage them. Yet, arbitrage is a necessary tool in the marketplace as it quickly eliminates market inefficiencies and keeps prices uniform across markets [2, 5, 11, 6, 3, 17].


Preparing for AI jobs: Why Nanodegrees are the future of education - Watson

#artificialintelligence

Large enterprises, startups and high-performance businesses across industries are increasingly turning to Artificial Intelligence and advanced analytics to make faster, more effective, data-driven decisions. The volume of unstructured and structured data stored by enterprises is growing at an accelerating rate. The demand for skilled data scientists and candidates with AI skills is at an all-time high. Yet developing those skills typically requires significant investments of time, energy and money. Businesses are struggling to successfully deploy and manage AI projects due to lack of resources.


18 Best Artificial Intelligence Courses To Standout in The Future JA Directives

#artificialintelligence

Looking for Artificial Intelligence Tutorial to learn introduction to artificial intelligence? Grab the list of Best Artificial Intelligence Courses Online, Tutorials, and Training are offered by a number of massive open online course (MOOC) providers like Udemy, Coursera, and edX. Artificial Intelligence (AI) and machine intelligence are the most booming topics in every industry now. Some of this popular MOOC providers offer some in-depth artificial intelligence programs. The list of the Best Artificial Intelligence Certification is often taught by industry top AI researchers or experts and you will learn the best applications of artificial intelligence.


How leaders can prepare for AI in the workplace

#artificialintelligence

Artificial intelligence is transforming the way we work together and the workplace environment as a whole. The adoption rate of AI technology by businesses is skyrocketing as its use cases to improve processes and get ahead of competitors continue to unfold. But as we move into the age of AI and machine learning, there are significant concerns that AI technology could replace – or even eliminate – many of the jobs that exist today. Fortunately, there isn't much to worry about right now. The technology still has a long way to go, and as a McKinsey study revealed, 45 per cent of individual work activities could be automated using existing technology, but that doesn't mean that 45 per cent of jobs are going away.


Online learning using multiple times weight updating

arXiv.org Machine Learning

Online learning makes sequence of decisions with partial data arrival where next movement of data is unknown. In this paper, we have presented a new idea as multiple times weight updating that update the weight iteratively for same instance. The proposed technique analyzed with popular algorithms from literature and experimented using established tool. The results indicates that mistake rate reduces to zero or close to zero for various datasets and algorithms. The overhead running cost is not too expensive and achieving mistake rate close to zero further strengthen the proposed technique. The proposed technique could be helpful to meet real life challenges.


Accumulating Knowledge for Lifelong Online Learning

arXiv.org Machine Learning

Lifelong learning can be viewed as a continuous transfer learning procedure over consecutive tasks, where learning a given task depends on accumulated knowledge -- the so-called knowledge base. Most published work on lifelong learning makes a batch processing of each task, implying that a data collection step is required beforehand. We are proposing a new framework, lifelong online learning, in which the learning procedure for each task is interactive. This is done through a computationally efficient algorithm where the predicted result for a given task is made by combining two intermediate predictions: by using only the information from the current task and by relying on the accumulated knowledge. In this work, two challenges are tackled: making no assumption on the task generation distribution, and processing with a possibly unknown number of instances for each task. We are providing a theoretical analysis of this algorithm, with a cumulative error upper bound for each task. We find that under some mild conditions, the algorithm can still benefit from a small cumulative error even when facing few interactions. Moreover, we provide experimental results on both synthetic and real datasets that validate the correct behaviour and practical usefulness of the proposed algorithm.