Education
Reliability and Learnability of Human Bandit Feedback for Sequence-to-Sequence Reinforcement Learning
Kreutzer, Julia, Uyheng, Joshua, Riezler, Stefan
We present a study on reinforcement learning (RL) from human bandit feedback for sequence-to-sequence learning, exemplified by the task of bandit neural machine translation (NMT). We investigate the reliability of human bandit feedback, and analyze the influence of reliability on the learnability of a reward estimator, and the effect of the quality of reward estimates on the overall RL task. Our analysis of cardinal (5-point ratings) and ordinal (pairwise preferences) feedback shows that their intra- and inter-annotator $\alpha$-agreement is comparable. Best reliability is obtained for standardized cardinal feedback, and cardinal feedback is also easiest to learn and generalize from. Finally, improvements of over 1 BLEU can be obtained by integrating a regression-based reward estimator trained on cardinal feedback for 800 translations into RL for NMT. This shows that RL is possible even from small amounts of fairly reliable human feedback, pointing to a great potential for applications at larger scale.
Designing for Democratization: Introducing Novices to Artificial Intelligence Via Maker Kits
Dibia, Victor, Ashoori, Maryam, Cox, Aaron, Weisz, Justin
Existing research highlight the myriad of benefits realized when technology is sufficiently democratized and made accessible to non-technical or novice users. However, democratizing complex technologies such as artificial intelligence (AI) remains hard. In this work, we draw on theoretical underpinnings from the democratization of innovation, in exploring the design of maker kits that help introduce novice users to complex technologies. We report on our work designing TJBot: an open source cardboard robot that can be programmed using pre-built AI services. We highlight principles we adopted in this process (approachable design, simplicity, extensibility and accessibility), insights we learned from showing the kit at workshops (66 participants) and how users interacted with the project on GitHub over a 12-month period (Nov 2016 - Nov 2017). We find that the project succeeds in attracting novice users (40\% of users who forked the project are new to GitHub) and a variety of demographics are interested in prototyping use cases such as home automation, task delegation, teaching and learning.
Modern Python Solutions - Part 2 Udemy
Python is the preferred choice of developers, engineers, data scientists, and hobbyists everywhere. It is a great scripting language that can power your applications and provide great speed, safety, and scalability. By exposing Python as a series of simple recipes, you can gain insight into specific language features in a particular context. Having a tangible context helps make the language or standard library features easier to understand. This video comes with over 100 recipes on the latest version of Python.
machine learning with text for beginners Udemy
What is machine learning / ai? How to lean machine learning in python? Good questions here is a point to start searching for an answer. In the world of today and especially tomorrow machine learning will be the driving force of the economy. No matter who you are, an entrepreneur or an employee, machine learning will be on your agenda.
Machine Learning Optimization Using Genetic Algorithm
In this course, you will learn what hyperparameters are, what Genetic Algorithm is, and what hyperparameter optimization is. In this course, you will apply Genetic Algorithm to optimize the performance of Support Vector Machines and Multilayer Perceptron Neural Networks. Hyperparameter optimization will be done on two datasets, a regression dataset for the prediction of cooling and heating loads of buildings, and a classification dataset regarding the classification of emails into spam and non-spam. The SVM and MLP will be applied on the datasets without optimization and compare their results to after their optimization. By the end of this course, you will have learnt how to code Genetic Algorithm in Python and how to optimize your Machine Learning algorithms for maximal performance.
Classification-Based Machine Learning for Finance
Finally, a comprehensive hands-on machine learning course with specific focus on classification based models for the investment community and passionate investors. In the past few years, there has been a massive adoption and growth in the use of data science, artificial intelligence and machine learning to find alpha. However, information on and application of machine learning to investment are scarce. This course has been designed to address that. It is meant to spark your creative juices and get you started in this space.
Neural Networks for Machine Learning Coursera
This was an awesome "after-intro" for machine learning. I was actually really happy to have gained the insight from Hinton directly, since he provided some really intuitive arguments for a lot of the modern techniques in neural network design and training. I wish there was a bit more exposure to tools, but I believe the focus was to get students who already are exposed to tools and give them a "boost" of knowledge. For example, I currently know of no framework that allows for quick design of RBMs. It would be interesting to at least take a look at tools for this and get exposure to frameworks that his team uses.
Skill shift: Automation and the future of the workforce
Demand for technological, social and emotional, and higher cognitive skills will rise by 2030. How will workers and organizations adapt? Skill shifts have accompanied the introduction of new technologies in the workplace since at least the Industrial Revolution, but adoption of automation and artificial intelligence (AI) will mark an acceleration over the shifts of even the recent past. The need for some skills, such as technological as well as social and emotional skills, will rise, even as the demand for others, including physical and manual skills, will fall. These changes will require workers everywhere to deepen their existing skill sets or acquire new ones. Companies, too, will need to rethink how work is organized within their organizations.