Goto

Collaborating Authors

 Instructional Material


Schedule-Robust Online Continual Learning

arXiv.org Artificial Intelligence

A hallmark of natural intelligence is its ability to continually absorb new knowledge while retaining and updating existing one. Achieving this objective in machines is the goal of continual learning (CL). Ideally, CL algorithms learn online from a never-ending and non-stationary stream of data, without catastrophic forgetting (McCloskey and Cohen, 1989; Ratcliff, 1990; French, 1999). The non-stationarity of the data stream is modeled by some schedule that defines what data arrives and how its distribution evolves over time. Two family of schedules commonly investigated are task-based (De Lange et al., 2021) and task-free (Aljundi et al., 2019a). The task-based setting assumes that new data arrives one task at a time and data distribution is stationary for each task. Many CL algorithms (e.g., Buzzega et al., 2020; Kirkpatrick et al., 2017; Hou et al., 2019) thus train offline, with multiple passes and shuffles over task data. The task-free setting does not assume the existence of separate tasks but instead expects CL algorithms to learn online from streaming data, with evolving sample distribution (Caccia et al., 2022; Shanahan et al., 2021).


Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction

arXiv.org Artificial Intelligence

The uses of robots are changing from static environments in factories to encompass novel concepts such as Human-Robot Collaboration in unstructured settings. Pre-programming all the functionalities for robots becomes impractical, and hence, robots need to learn how to react to new events autonomously, just like humans. However, humans, unlike machines, are naturally skilled in responding to unexpected circumstances based on either experiences or observations. Hence, embedding such anthropoid behaviours into robots entails the development of neuro-cognitive models that emulate motor skills under a robot learning paradigm. Effective encoding of these skills is bound to the proper choice of tools and techniques. This paper studies different motion and behaviour learning methods ranging from Movement Primitives (MP) to Experience Abstraction (EA), applied to different robotic tasks. These methods are scrutinized and then experimentally benchmarked by reconstructing a standard pick-n-place task. Apart from providing a standard guideline for the selection of strategies and algorithms, this paper aims to draw a perspectives on their possible extensions and improvements


Data Science Fundamentals with Python and SQL

#artificialintelligence

In order to be successful in Data Science, you need to be skilled with using tools that Data Science professionals employ as part of their jobs. This course teaches you about the popular tools in Data Science and how to use them. You will become familiar with the Data Scientist's tool kit which includes: Libraries & Packages, Data Sets, Machine Learning Models, Kernels, as well as the various Open source, commercial, Big Data and Cloud-based tools. You will understand what each tool is used for, what programming languages they can execute, their features and limitations. This course gives plenty of hands-on experience in order to develop skills for working with these Data Science Tools.


A Dagster Crash Course

#artificialintelligence

Hey - I'm the head of engineering at Elementl, the company that builds Dagster. This post is my take on a crash-course introduction to Dagster. And if you want to support the Dagster Open Source project, be sure to star our Github repo. Dagster is a data orchestrator. Think of Dagster as a framework for building data pipelines, similar to how Django is a framework for building web apps.


5 Free Courses to Master Linear Algebra - KDnuggets

#artificialintelligence

Data Science is the buzzword, and a lot of enthusiasts are interested in learning its fundamentals to make a lucrative career in this field. Linear Algebra is one of the important concepts to learn how to perform data transformation techniques like pre-processing, dimensionality reduction, etc. There are many courses available at your fingertip, but it is difficult to choose the right course suited for your requirement. That's precisely the intent of this post - it makes your course search easy by listing down the five free courses to learn linear algebra foundations for data science. Before I go straight into listing down the courses for you, let me first explain the commonly asked questions – why do we need to learn linear algebra in the first place?


The Complete Free PyTorch Course for Deep Learning - KDnuggets

#artificialintelligence

This is the complete PyTorch for machine learning and deep learning that you've been looking for. The course PyTorch for Deep Learning & Machine Learning from freeCodeCamp is put together by machine learning stalwart Daniel Bourke. You might know Daniel from his prolific online presence over the past number of years, where he has blogged and created content related to machine learning for some time now. This course will teach you the foundations of machine learning and deep learning with PyTorch (a machine learning framework written in Python). The course is video based.


Ifeanyi Nwaneri on LinkedIn: I'm happy to share that I've obtained a new certification: AWS Machine…

#artificialintelligence

I'm happy to share that I've obtained a new certification: AWS Machine Learning Foundations from Udacity! One of the things I found interesting about this course is my recent exposure to and hands-on experience with generative AI. Generative AI gives the ability to create new 3d cad designs, and generate new data, algorithms, etc. from a pre-trained model. In the coming days, I will be exploring Generative AI in the design of robot components. Special appreciation to AWS amazon and Udacity for the privilege to participate in this program.


Financial Engineering and Artificial Intelligence in Python

#artificialintelligence

Have you ever thought about what would happen if you combined the power of machine learning and artificial intelligence with financial engineering? Today, you can stop imagining, and start doing. This course will teach you the core fundamentals of financial engineering, with a machine learning twist. We will cover must-know topics in financial engineering, such as: Exploratory data analysis, significance testing, correlations, alpha and beta Time series analysis, simple moving average, exponentially-weighted moving average Holt-Winters exponential smoothing model Efficient Market Hypothesis Random Walk Hypothesis Time series forecasting ("stock price prediction") Modern portfolio theory Efficient frontier / Markowitz bullet Mean-variance optimization Maximizing the Sharpe ratio Convex optimization with Linear Programming and Quadratic Programming Capital Asset Pricing Model (CAPM) Algorithmic trading (VIP only) Statistical Factor Models (VIP only) Regime Detection with Hidden Markov Models (VIP only) In addition, we will look at various non-traditional techniques which stem purely from the field of machine learning and artificial intelligence, such as: Classification models Unsupervised learning Reinforcement learning and Q-learning We will learn about the greatest flub made in the past decade by marketers posing as "machine learning experts" who promise to teach unsuspecting students how to "predict stock prices with LSTMs". You will learn exactly why their methodology is fundamentally flawed and why their results are complete nonsense.


Advanced Reinforcement Learning in Python: cutting-edge DQNs

#artificialintelligence

This course will introduce you to the state of the art in Reinforcement Learning techniques. It will also prepare you for the next courses in this series, where we will explore other advanced methods that excel in other types of task. The course is focused on developing practical skills. Therefore, after learning the most important concepts of each family of methods, we will implement one or more of their algorithms in jupyter notebooks, from scratch.


ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution

arXiv.org Artificial Intelligence

Large-scale, high-quality corpora are critical for advancing research in coreference resolution. However, existing datasets vary in their definition of coreferences and have been collected via complex and lengthy guidelines that are curated for linguistic experts. These concerns have sparked a growing interest among researchers to curate a unified set of guidelines suitable for annotators with various backgrounds. In this work, we develop a crowdsourcing-friendly coreference annotation methodology, ezCoref, consisting of an annotation tool and an interactive tutorial. We use ezCoref to re-annotate 240 passages from seven existing English coreference datasets (spanning fiction, news, and multiple other domains) while teaching annotators only cases that are treated similarly across these datasets. Surprisingly, we find that reasonable quality annotations were already achievable (>90% agreement between the crowd and expert annotations) even without extensive training. On carefully analyzing the remaining disagreements, we identify the presence of linguistic cases that our annotators unanimously agree upon but lack unified treatments (e.g., generic pronouns, appositives) in existing datasets. We propose the research community should revisit these phenomena when curating future unified annotation guidelines.