Education
Training Your Systems with Python Statistical Modeling
Python, a multi-paradigm programming language, has become the language of choice for data scientists for data analysis, visualization, and machine learning. This course takes you through the various different concepts that get you acquainted and working with the different aspects of Machine Learning. You'll start by diving into classical statistical analysis, where you will learn to compute descriptive statistics with Pandas. From there, you will be introduced to supervised learning, where you will explore the principles of machine learning and train different machine learning models. After that, you'll work with algorithms for regression analysis, and employ different types of regression, such as ridge and lasso regression, and spline interpolation using SciPy.
How Machine Learning Can Enhance Education System
Without a doubt, the advanced transformation has changed about each industry. At the cutting edge of this digital revolution are Artificial Intelligence (AI) and Machine Learning (ML). Many industries like the education system, transportation, healthcare, and marketing have started adopting the emerging technology to enhance their business plans of action. Machine learning, a subset of Artificial Intelligence (AI) is getting more popularity and acceptance in almost every industry. The main objective of machine learning is to allow the computer to learn and perform actions automatically without human help and fine-tune the actions appropriately. This is the reason why machine learning is gaining importance in many industries.
Parallel programming Coursera
About this course: With every smartphone and computer now boasting multiple processors, the use of functional ideas to facilitate parallel programming is becoming increasingly widespread. In this course, you'll learn the fundamentals of parallel programming, from task parallelism to data parallelism. In particular, you'll see how many familiar ideas from functional programming map perfectly to to the data parallel paradigm. We'll start the nuts and bolts how to effectively parallelize familiar collections operations, and we'll build up to parallel collections, a production-ready data parallel collections library available in the Scala standard library. Throughout, we'll apply these concepts through several hands-on examples that analyze real-world data, such as popular algorithms like k-means clustering.
fast.ai · Making neural nets uncool again
Today we are launching the 2018 edition of Cutting Edge Deep Learning for Coders, part 2 of fast.ai's Just as with our part 1 Practical Deep Learning for Coders, there are no pre-requisites beyond high school math and 1 year of coding experience--we teach you everything else you need along the way. This course contains all new material, including new state of the art results in NLP classification (up to 20% better than previously known approaches), and shows how to replicate recent record-breaking performance results on Imagenet and CIFAR10. The main libraries used are PyTorch and fastai (we explain why we use PyTorch and why we created the fastai library in this article). Each of the seven lessons includes a video that's around two hours long, an interactive Jupyter notebook, and a dedicated discussion thread on the fast.ai
The Deep Learning Masterclass: Classify Images with Keras!
Welcome to this epic masterclass on Keras (and so much more) with our #1 data scientist and app developer Nimish Narang, creator of over 20 Mammoth Interactive courses and a top-seller on Udemy. Anyone can take this course. If you already have experience using PyCharm and running Python files and programs on the interface, you can simply skip ahead to whatever section best suits your needs. Or, you can follow the progression of this meticulously curated course especially designed to take any absolute beginner off the street and make them a data modeler. This course is divided into days, but of course you can learn at your own pace.
Randomized Smoothing SVRG for Large-scale Nonsmooth Convex Optimization
In this paper, we consider the problem of minimizing the average of a large number of nonsmooth and convex functions. Such problems often arise in typical machine learning problems as empirical risk minimization, but are computationally very challenging. We develop and analyze a new algorithm that achieves robust linear convergence rate, and both its time complexity and gradient complexity are superior than state-of-art nonsmooth algorithms and subgradient-based schemes. Besides, our algorithm works without any extra error bound conditions on the objective function as well as the common strongly-convex condition. We show that our algorithm has wide applications in optimization and machine learning problems, and demonstrate experimentally that it performs well on a large-scale ranking problem.
Fast Rates of ERM and Stochastic Approximation: Adaptive to Error Bound Conditions
Liu, Mingrui, Zhang, Xiaoxuan, Zhang, Lijun, Jin, Rong, Yang, Tianbao
Error bound conditions (EBC) are properties that characterize the growth of an objective function when a point is moved away from the optimal set. They have recently received increasing attention in the field of optimization for developing optimization algorithms with fast convergence. However, the studies of EBC in statistical learning are hitherto still limited. The main contributions of this paper are two-fold. First, we develop fast and intermediate rates of empirical risk minimization (ERM) under EBC for risk minimization with Lipschitz continuous, and smooth convex random functions. Second, we establish fast and intermediate rates of an efficient stochastic approximation (SA) algorithm for risk minimization with Lipschitz continuous random functions, which requires only one pass of $n$ samples and adapts to EBC. For both approaches, the convergence rates span a full spectrum between $\widetilde O(1/\sqrt{n})$ and $\widetilde O(1/n)$ depending on the power constant in EBC, and could be even faster than $O(1/n)$ in special cases for ERM. Moreover, these convergence rates are automatically adaptive without using any knowledge of EBC. Overall, this work not only strengthens the understanding of ERM for statistical learning but also brings new fast stochastic algorithms for solving a broad range of statistical learning problems.
Behavioral Cloning from Observation
Torabi, Faraz, Warnell, Garrett, Stone, Peter
Humans often learn how to perform tasks via imitation: they observe others perform a task, and then very quickly infer the appropriate actions to take based on their observations. While extending this paradigm to autonomous agents is a well-studied problem in general, there are two particular aspects that have largely been overlooked: (1) that the learning is done from observation only (i.e., without explicit action information), and (2) that the learning is typically done very quickly. In this work, we propose a two-phase, autonomous imitation learning technique called behavioral cloning from observation (BCO), that aims to provide improved performance with respect to both of these aspects. First, we allow the agent to acquire experience in a self-supervised fashion. This experience is used to develop a model which is then utilized to learn a particular task by observing an expert perform that task without the knowledge of the specific actions taken. We experimentally compare BCO to imitation learning methods, including the state-of-the-art, generative adversarial imitation learning (GAIL) technique, and we show comparable task performance in several different simulation domains while exhibiting increased learning speed after expert trajectories become available.
Extracting Action Sequences from Texts Based on Deep Reinforcement Learning
Feng, Wenfeng, Zhuo, Hankz Hankui, Kambhampati, Subbarao
Extracting action sequences from natural language texts is challenging, as it requires commonsense inferences based on world knowledge. Although there has been work on extracting action scripts, instructions, navigation actions, etc., they require that either the set of candidate actions be provided in advance, or that action descriptions are restricted to a specific form, e.g., description templates. In this paper, we aim to extract action sequences from texts in free natural language, i.e., without any restricted templates, provided the candidate set of actions is unknown. We propose to extract action sequences from texts based on the deep reinforcement learning framework. Specifically, we view "selecting" or "eliminating" words from texts as "actions", and the texts associated with actions as "states". We then build Q-networks to learn the policy of extracting actions and extract plans from the labeled texts. We demonstrate the effectiveness of our approach on several datasets with comparison to state-of-the-art approaches, including online experiments interacting with humans.