Education
Mathematics for Machine Learning
Would you like to learn the mathematics behind machine learning? There aren't many resources out there that give simple detailed examples and that walk you through the topics step by step. If you're looking to gain a solid foundation in machine learning, allowing you to study on your own schedule at a fraction of the cost it would take at a traditional university, to further your career goals, this online course is for you. If you're a working professional needing a refresher on machine learning or a complete beginner who needs to learn machine learning for the first time, this online course is for you. Why you should take this online course: You need to refresh your knowledge of machine learning for your career to earn a higher salary.
Online Tool Condition Monitoring Based on Parsimonious Ensemble+
Pratama, Mahardhika, Dimla, Eric, Lughofer, Edwin, Pedrycz, Witold, Tjahjowidowo, Tegoeh
Accurate diagnosis of tool wear in metal turning process remains an open challenge for both scientists and industrial practitioners because of inhomogeneities in workpiece material, nonstationary machining settings to suit production requirements, and nonlinear relations between measured variables and tool wear. Common methodologies for tool condition monitoring still rely on batch approaches which cannot cope with a fast sampling rate of metal cutting process. Furthermore they require a retraining process to be completed from scratch when dealing with a new set of machining parameters. This paper presents an online tool condition monitoring approach based on Parsimonious Ensemble+, pENsemble+. The unique feature of pENsemble+ lies in its highly flexible principle where both ensemble structure and base-classifier structure can automatically grow and shrink on the fly based on the characteristics of data streams. Moreover, the online feature selection scenario is integrated to actively sample relevant input attributes. The paper presents advancement of a newly developed ensemble learning algorithm, pENsemble+, where online active learning scenario is incorporated to reduce operator labelling effort. The ensemble merging scenario is proposed which allows reduction of ensemble complexity while retaining its diversity. Experimental studies utilising real-world manufacturing data streams and comparisons with well known algorithms were carried out. Furthermore, the efficacy of pENsemble was examined using benchmark concept drift data streams. It has been found that pENsemble+ incurs low structural complexity and results in a significant reduction of operator labelling effort.
Online Learning for Changing Environments using Coin Betting
Jun, Kwang-Sung, Orabona, Francesco, Wright, Stephen, Willett, Rebecca
A key challenge in online learning is that classical algorithms can be slow to adapt to changing environments. Recent studies have proposed "meta" algorithms that convert any online learning algorithm to one that is adaptive to changing environments, where the adaptivity is analyzed in a quantity called the strongly-adaptive regret. This paper describes a new meta algorithm that has a strongly-adaptive regret bound that is a factor of $\sqrt{\log(T)}$ better than other algorithms with the same time complexity, where $T$ is the time horizon. We also extend our algorithm to achieve a first-order (i.e., dependent on the observed losses) strongly-adaptive regret bound for the first time, to our knowledge. At its heart is a new parameter-free algorithm for the learning with expert advice (LEA) problem in which experts sometimes do not output advice for consecutive time steps (i.e., \emph{sleeping} experts). This algorithm is derived by a reduction from optimal algorithms for the so-called coin betting problem. Empirical results show that our algorithm outperforms state-of-the-art methods in both learning with expert advice and metric learning scenarios.
Deep Neural Networks
Balestriero, Randall, Baraniuk, Richard
Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now commonly tackled via DNNs. Some fundamental problems remain: (1) the lack of a mathematical framework providing an explicit and interpretable input-output formula for any topology, (2) quantification of DNNs stability regarding adversarial examples (i.e. modified inputs fooling DNN predictions whilst undetectable to humans), (3) absence of generalization guarantees and controllable behaviors for ambiguous patterns, (4) leverage unlabeled data to apply DNNs to domains where expert labeling is scarce as in the medical field. Answering those points would provide theoretical perspectives for further developments based on a common ground. Furthermore, DNNs are now deployed in tremendous societal applications, pushing the need to fill this theoretical gap to ensure control, reliability, and interpretability.
Computer says no: why making AIs fair, accountable and transparent is crucial
In October, American teachers prevailed in a lawsuit with their school district over a computer program that assessed their performance. The system rated teachers in Houston by comparing their students' test scores against state averages. Those with high ratings won praise and even bonuses. Those who fared poorly faced the sack. The program did not please everyone.
Getting Started with Machine Learning in One Hour!
I was planning agenda for my one hour talk. Conveying the learning paths, setting up the environment and explaining the important machine learning concepts finally made it to agenda after a lot of contemplation and thought. I initially thought about various ways this talk could have been done including - hands on python with linear regression, explaining linear regression in detail, or just sharing my learning journey that I went through past 18 months almost. But I wanted to start something that leaves the audience with lots of new information and questions to work on. Create curiosity and interest in them.
The biggest roadblock in AI adoption is a lack of skilled workers
While there is nearly universal agreement that artificial intelligence offers the promise of revolutionary benefits, recent survey findings from Gartner reveal almost 60 percent of organizations surveyed have yet to take advantage of the benefits of AI. Perhaps even more surprisingly, only a little more than 10 percent of surveyed businesses have deployed or implemented any AI solution at all. Based on the survey, there appears to be a gap between AI's promise and the ability for an enterprise to implement it. A further confirmation of that point is the finding that close to half of the surveyed organizations state they prefer to buy pre-packaged AI solutions or use AI capabilities already embedded in their applications. This shouldn't be a surprise as end-user organizations are looking to use AI to help better solve business problems.
A Data Science Workflow – Towards Data Science – Medium
The Jupyter Notebook can be found here. There is no template for solving a data science problem. But we do see similar steps in many different projects. I wanted to make a clean workflow to serve as an example to aspiring data scientists. I also wanted to give people working with data scientists an easy to understand guide to data science. This is a high-level overview and every step (and almost every sentence) in this overview can be addressed on its own. Many books like Introduction to Statistical Learning by Hastie and Tibshirani and many courses like Andrew Ng's Machine Learning course at Stanford, go into these topics in more detail. The data science community is full of great literature and great resources. Be sure to dive deeper into any topic you find interesting.
A Deep Reinforcement Learning Chatbot
Serban, Iulian V., Sankar, Chinnadhurai, Germain, Mathieu, Zhang, Saizheng, Lin, Zhouhan, Subramanian, Sandeep, Kim, Taesup, Pieper, Michael, Chandar, Sarath, Ke, Nan Rosemary, Rajeshwar, Sai, de Brebisson, Alexandre, Sotelo, Jose M. R., Suhubdy, Dendi, Michalski, Vincent, Nguyen, Alexandre, Pineau, Joelle, Bengio, Yoshua
We present MILABOT: a deep reinforcement learning chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition. MILABOT is capable of conversing with humans on popular small talk topics through both speech and text. The system consists of an ensemble of natural language generation and retrieval models, including template-based models, bag-of-words models, sequence-to-sequence neural network and latent variable neural network models. By applying reinforcement learning to crowdsourced data and real-world user interactions, the system has been trained to select an appropriate response from the models in its ensemble. The system has been evaluated through A/B testing with real-world users, where it performed significantly better than many competing systems. Due to its machine learning architecture, the system is likely to improve with additional data.