Education
Deep Learning to Predict Student Outcomes
The increasingly fast development cycle for online course contents, along with the diverse student demographics in each online classroom, make real-time student outcomes prediction an interesting topic for both industrial research and practical needs. In this paper, we tackle the problem of real-time student performance prediction in an on-going course using a domain adaptation framework. This framework is a system trained on labeled student outcome data from previous coursework but is meant to be deployed on another course. In particular, we introduce a GritNet architecture, and develop an unsupervised domain adaptation method to transfer a GritNet trained on a past course to a new course without any student outcome label. Our results for real Udacity student graduation predictions show that the GritNet not only generalizes well from one course to another across different Nanodegree programs, but also enhances real-time predictions explicitly in the first few weeks when accurate predictions are most challenging.
Understanding Dataset Design Choices for Multi-hop Reasoning
Learning multi-hop reasoning has been a key challenge for reading comprehension models, leading to the design of datasets that explicitly focus on it. Ideally, a model should not be able to perform well on a multi-hop question answering task without doing multi-hop reasoning. In this paper, we investigate two recently proposed datasets, WikiHop and HotpotQA. First, we explore sentence-factored models for these tasks; by design, these models cannot do multi-hop reasoning, but they are still able to solve a large number of examples in both datasets. Furthermore, we find spurious correlations in the unmasked version of WikiHop, which make it easy to achieve high performance considering only the questions and answers. Finally, we investigate one key difference between these datasets, namely span-based vs. multiple-choice formulations of the QA task. Multiple-choice versions of both datasets can be easily gamed, and two models we examine only marginally exceed a baseline in this setting. Overall, while these datasets are useful testbeds, high-performing models may not be learning as much multi-hop reasoning as previously thought.
SDET/Test Architect Essentials -Road to Full stack QA
SDET/Test Architect Essentials -Road to Full stack QA by Rahul Shetty Advanced Tutorial to Learn essential skills needed to transform your career from QA Engineer to SDET/Test Architect The one and only Best "Full Stack QA tutorial" which touches up on technical challenges in every phase of Automation by providing smart solutions using latest technologies like Dockers, Jackson API, Jenkin Pipelines, Data Structures using Java Streams, Window batch Scripting, Database readers, GIt and many more!!!!!!!! After Successful course completion, you should be able to apply for any Test Architect /SDET positions or lead the Challenging Automation projects from Scratch Below are in detail Scenarios we are going to cover in this Tutorial Dockerization, integrating Selenium Grid with Docker, Building Json/Xml from database results, Parsing Json into Java objects with Jackson API, Jenkins pipeline Scripting for CI/CD, Dynamically monitoring Server Logs with Java, Windows Batch job scripting, Dataprovider to Excel Integration, Java streams, Lambda expreesions, GIT version control system and many more, What you'll learn Understand and Implement Docker to provide virtualization Environments for Automation Tests Build Json/Xml on fly from JDBC Query results with Jackson API and POJO implementation Build and execute Window batch Scripts for invoking Servers(Selenium/Protractor) Understand Jenkin pipelines scripting for CI/CD Complete knowledge on latest Java Streams and lambda expressions for Interview prep Parsing Json files into Java objects to feed into web Automation tests How to monitor server logs dynamically with java Integrating TestNG Data provider into excel for building robust Datadriven Automation Understanding GIT commands in depth versioncontrol Who this course is for: GET Udemy Discount 95% off SDET/Test Architect Essentials -Road to Full stack QA
Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theory
Deep learning based knowledge tracing model has been shown to outperform traditional knowledge tracing model without the need for human-engineered features, yet its parameters and representations have long been criticized for not being explainable. In this paper, we propose Deep-IRT which is a synthesis of the item response theory (IRT) model and a knowledge tracing model that is based on the deep neural network architecture called dynamic key-value memory network (DKVMN) to make deep learning based knowledge tracing explainable. Specifically, we use the DKVMN model to process the student's learning trajectory and estimate the student ability level and the item difficulty level over time. Then, we use the IRT model to estimate the probability that a student will answer an item correctly using the estimated student ability and the item difficulty. Experiments show that the Deep-IRT model retains the performance of the DKVMN model, while it provides a direct psychological interpretation of both students and items.
Automatic alignment of surgical videos using kinematic data
Fawaz, Hassan Ismail, Forestier, Germain, Weber, Jonathan, Petitjean, Franรงois, Idoumghar, Lhassane, Muller, Pierre-Alain
Over the past one hundred years, the classic teaching methodology of "see one, do one, teach one" has governed the surgical education systems worldwide. With the advent of Operation Room 2.0, recording video, kinematic and many other types of data during the surgery became an easy task, thus allowing artificial intelligence systems to be deployed and used in surgical and medical practice. Recently, surgical videos has been shown to provide a structure for peer coaching enabling novice trainees to learn from experienced surgeons by replaying those videos. However, the high inter-operator variability in surgical gesture duration and execution renders learning from comparing novice to expert surgical videos a very difficult task. In this paper, we propose a novel technique to align multiple videos based on the alignment of their corresponding kinematic multivariate time series data. By leveraging the Dynamic Time Warping measure, our algorithm synchronizes a set of videos in order to show the same gesture being performed at different speed. We believe that the proposed approach is a valuable addition to the existing learning tools for surgery.
Online Learning Algorithms for Quaternion ARMA Model
In recent years, quaternion algebra has attracted considerable attention in the signal processing community. As a natural representation of 3D and 4D signals, quaternion allows for a reduction in the number of parameters and operations involved, and can bring insights that would not be acquired by real-and complexvalued representations. Due to these elegant properties, quaternion adaptive signal processing algorithms have developed rapidly and have achieved satisfactory performance in a wide range of applications [1]-[8]. Despite the existence of many quaternion algorithms, we notice that so far, there is no learning algorithm for the ARMA model in the quaternion domain.
Robust Metric Learning based on the Rescaled Hinge Loss
Al-Obaidi, Sumia Abdulhussien Razooqi, Zabihzadeh, Davood, Rasheed, Ali Salim, Monsefi, Reza
Distance/Similarity learning is a fundamental problem in machine learning. For example, kNN classifier or clustering methods are based on a distance/similarity measure. Metric learning algorithms enhance the efficiency of these methods by learning an optimal distance function from data. Most metric learning methods need training information in the form of pair or triplet sets. Nowadays, this training information often is obtained from the Internet via crowdsourcing methods. Therefore, this information may contain label noise or outliers leading to the poor performance of the learned metric. It is even possible that the learned metric functions perform worse than the general metrics such as Euclidean distance. To address this challenge, this paper presents a new robust metric learning method based on the Rescaled Hinge loss. This loss function is a general case of the popular Hinge loss and initially introduced in (Xu et al. 2017) to develop a new robust SVM algorithm. In this paper, we formulate the metric learning problem using the Rescaled Hinge loss function and then develop an efficient algorithm based on HQ (Half-Quadratic) to solve the problem. Experimental results on a variety of both real and synthetic datasets confirm that our new robust algorithm considerably outperforms state-of-the-art metric learning methods in the presence of label noise and outliers.
Stability and Optimization Error of Stochastic Gradient Descent for Pairwise Learning
Shen, Wei, Yang, Zhenhuan, Ying, Yiming, Yuan, Xiaoming
In this paper we study the stability and its trade-off with optimization error for stochastic gradient descent (SGD) algorithms in the pairwise learning setting. Pairwise learning refers to a learning task which involves a loss function depending on pairs of instances among which notable examples are bipartite ranking, metric learning, area under ROC (AUC) maximization and minimum error entropy (MEE) principle. Our contribution is twofold. Firstly, we establish the stability results of SGD for pairwise learning in the convex, strongly convex and non-convex settings, from which generalization bounds can be naturally derived. Secondly, we establish the trade-off between stability and optimization error of SGD algorithms for pairwise learning. This is achieved by lower-bounding the sum of stability and optimization error by the minimax statistical error over a prescribed class of pairwise loss functions. From this fundamental trade-off, we obtain lower bounds for the optimization error of SGD algorithms and the excess expected risk over a class of pairwise losses. In addition, we illustrate our stability results by giving some specific examples of AUC maximization, metric learning and MEE.
Factored Contextual Policy Search with Bayesian Optimization
Pinsler, Robert, Karkus, Peter, Kupcsik, Andras, Hsu, David, Lee, Wee Sun
Scarce data is a major challenge to scaling robot learning to truly complex tasks, as we need to generalize locally learned policies over different task contexts. Contextual policy search offers data-efficient learning and generalization by explicitly conditioning the policy on a parametric context space. In this paper, we further structure the contextual policy representation. We propose to factor contexts into two components: target contexts that describe the task objectives, e.g. target position for throwing a ball; and environment contexts that characterize the environment, e.g. initial position or mass of the ball. Our key observation is that experience can be directly generalized over target contexts. We show that this can be easily exploited in contextual policy search algorithms. In particular, we apply factorization to a Bayesian optimization approach to contextual policy search both in sampling-based and active learning settings. Our simulation results show faster learning and better generalization in various robotic domains. See our supplementary video: https://youtu.be/MNTbBAOufDY.