Instructional Material
6 Data Science & ML Books Every Data Scientist Should Keep Nearby
The best way to stay in touch is to continue brushing up on your knowledge about data science while also maintaining experience. It's the perfect storm or combination of skills to help you succeed in the industry. Machine learning and data science are a complicated and involved set of interconnected concepts. To keep up, you need to be prepared to spend time doing research and brushing up on knowledge. Even working in the industry day in and day out, there are still ways to fall out of touch with the current trends.
How to Speed Up Deep Learning Inference Using TensorRT NVIDIA Developer Blog
Welcome to this introduction to TensorRT, our platform for deep learning inference. You will learn how to deploy a deep learning application onto a GPU, increasing throughput and reducing latency during inference. TensorRT provides APIs and parsers to import trained models from all major deep learning frameworks. It then generates optimized runtime engines deployable in the datacenter as well as in automotive and embedded environments. Applications deployed on GPUs with TensorRT perform up to 40x faster than CPU-only platforms. This tutorial uses a C example to walk you through importing an ONNX model into TensorRT, applying optimizations, and generating a high-performance runtime engine for the datacenter environment.
Modular Networks: Learning to Decompose Neural Computation
Kirsch, Louis, Kunze, Julius, Barber, David
Scaling model capacity has been vital in the success of deep learning. For a typical network, necessary compute resources and training time grow dramatically with model size. Conditional computation is a promising way to increase the number of parameters with a relatively small increase in resources. We propose a training algorithm that flexibly chooses neural modules based on the data to be processed. Both the decomposition and modules are learned end-to-end. In contrast to existing approaches, training does not rely on regularization to enforce diversity in module use. We apply modular networks both to image recognition and language modeling tasks, where we achieve superior performance compared to several baselines. Introspection reveals that modules specialize in interpretable contexts.
Chapter 1: Bird's Eye View of Applied Machine Learning - Data Science Primer
Welcome to our 7-part mini-course on data science and applied machine learning! Over these 7 chapters, our goal is to provide you with an end-to-end blueprint for applied machine learning, while keeping this as actionable and succinct as possible. With that, let's get started with a bird's eye view of the machine learning workflow. One really cool (optional) challenge you can do in the next hour is training your first machine learning model! That's right, we've put together a complete step-by-step tutorial for training a model that can predict wine quality.
A Bayesian Perspective of Statistical Machine Learning for Big Data
Sambasivan, Rajiv, Das, Sourish, Sahu, Sujit K
Statistical Machine Learning (SML) refers to a body of algorithms and methods by which computers are allowed to discover important features of input data sets which are often very large in size. The very task of feature discovery from data is essentially the meaning of the keyword `learning' in SML. Theoretical justifications for the effectiveness of the SML algorithms are underpinned by sound principles from different disciplines, such as Computer Science and Statistics. The theoretical underpinnings particularly justified by statistical inference methods are together termed as statistical learning theory. This paper provides a review of SML from a Bayesian decision theoretic point of view -- where we argue that many SML techniques are closely connected to making inference by using the so called Bayesian paradigm. We discuss many important SML techniques such as supervised and unsupervised learning, deep learning, online learning and Gaussian processes especially in the context of very large data sets where these are often employed. We present a dictionary which maps the key concepts of SML from Computer Science and Statistics. We illustrate the SML techniques with three moderately large data sets where we also discuss many practical implementation issues. Thus the review is especially targeted at statisticians and computer scientists who are aspiring to understand and apply SML for moderately large to big data sets.
Iterative Classroom Teaching
Yeo, Teresa, Kamalaruban, Parameswaran, Singla, Adish, Merchant, Arpit, Asselborn, Thibault, Faucon, Louis, Dillenbourg, Pierre, Cevher, Volkan
We consider the machine teaching problem in a classroom-like setting wherein the teacher has to deliver the same examples to a diverse group of students. Their diversity stems from differences in their initial internal states as well as their learning rates. We prove that a teacher with full knowledge about the learning dynamics of the students can teach a target concept to the entire classroom using O(min{d,N} log(1/eps)) examples, where d is the ambient dimension of the problem, N is the number of learners, and eps is the accuracy parameter. We show the robustness of our teaching strategy when the teacher has limited knowledge of the learners' internal dynamics as provided by a noisy oracle. Further, we study the trade-off between the learners' workload and the teacher's cost in teaching the target concept. Our experiments validate our theoretical results and suggest that appropriately partitioning the classroom into homogenous groups provides a balance between these two objectives.
How to launch your data science career (with Python)
If you're interested in the exciting world of data science, but don't know where to start, Data School is here to help. Data science can be an overwhelming field. Many people will tell you that you can't become a data scientist until you master the following: statistics, linear algebra, calculus, programming, databases, distributed computing, machine learning, visualization, experimental design, clustering, deep learning, natural language processing, and more. So, what exactly is data science? This workflow doesn't necessarily require advanced mathematics, a mastery of deep learning, or many of the other skills listed above.
The Future of AI in PR: Featuring Paul Roetzer - Cision
As a PR pro, what should you know about AI's impact on comms? Whether your brand is leveraging AI already, your target consumers are already engaging with it every day, through tools like Siri, Alexa, Netflix, or Google Maps. Artificial intelligence has the potential to save your company massive amounts of time and money, making your entire go to market process more efficient. But what's the best way to incorporate AI into you comms strategy? Take 6 minutes to absorb our latest video, and get critical insight from Paul Roetzer, founder of the Marketing Artificial Intelligence Institute, as he answers all the questions you may have about AI's impact on PR and marketing.
LSTM Model Architecture for Rare Event Time Series Forecasting
Time series forecasting with LSTMs directly has shown little success. This is surprising as neural networks are known to be able to learn complex non-linear relationships and the LSTM is perhaps the most successful type of recurrent neural network that is capable of directly supporting multivariate sequence prediction problems. A recent study performed at Uber AI Labs demonstrates how both the automatic feature learning capabilities of LSTMs and their ability to handle input sequences can be harnessed in an end-to-end model that can be used for drive demand forecasting for rare events like public holidays. In this post, you will discover an approach to developing a scalable end-to-end LSTM model for time series forecasting. In this post, we will review the 2017 paper titled "Time-series Extreme Event Forecasting with Neural Networks at Uber" by Nikolay Laptev, et al. presented at the Time Series Workshop, ICML 2017.