Instructional Material
Learning Deformable Object Manipulation from Expert Demonstrations
Salhotra, Gautam, Liu, I-Chun Arthur, Dominguez-Kuhne, Marcus, Sukhatme, Gaurav S.
We present a novel Learning from Demonstration (LfD) method, Deformable Manipulation from Demonstrations (DMfD), to solve deformable manipulation tasks using states or images as inputs, given expert demonstrations. Our method uses demonstrations in three different ways, and balances the trade-off between exploring the environment online and using guidance from experts to explore high dimensional spaces effectively. We test DMfD on a set of representative manipulation tasks for a 1-dimensional rope and a 2-dimensional cloth from the SoftGym suite of tasks, each with state and image observations. Our method exceeds baseline performance by up to 12.9% for state-based tasks and up to 33.44% on image-based tasks, with comparable or better robustness to randomness. Additionally, we create two challenging environments for folding a 2D cloth using image-based observations, and set a performance benchmark for them. We deploy DMfD on a real robot with a minimal loss in normalized performance during real-world execution compared to simulation (~6%). Source code is on github.com/uscresl/dmfd
Everything you need to know about the Naive Bayes algorithm
Naive Bayes is a probabilistic machine learning algorithm that is based on the Bayes Theorem and is used for a wide range of classification challenges. In this blog, we will learn about the Naive Bayes algorithm and all of its core concepts so that there are no gaps in the information. As we all know, machine learning is the technology that predicts goal B using characteristics A, i.e., computing the conditional probability P(B A). Then, for the discriminative model, we only take into account assessing the conditional probability. This establishes the classifier under the condition of a limited sample, without evaluating the sample's generative model, instead of learning the prediction model, like in the binary classification problem.
New Auction Algorithms for Path Planning, Network Transport, and Reinforcement Learning
We consider some classical optimization problems in path planning and network transport, and we introduce new auction-based algorithms for their optimal and suboptimal solution. The algorithms are based on mathematical ideas that are related to competitive bidding by persons for objects and the attendant market equilibrium, which underlie auction processes. However, the starting point of our algorithms is different, namely weighted and unweighted path construction in directed graphs, rather than assignment of persons to objects. The new algorithms have several potential advantages over existing methods: they are empirically faster in some important contexts, such as max-flow, they are well-suited for on-line replanning, and they can be adapted to distributed asynchronous operation. Moreover, they allow arbitrary initial prices, without complementary slackness restrictions, and thus are better-suited to take advantage of reinforcement learning methods that use off-line training with data, as well as on-line training during real-time operation. The new algorithms may also find use in reinforcement learning contexts involving approximation, such as multistep lookahead and tree search schemes, and/or rollout algorithms.
Data Science and Machine Learning in Education
Benelli, Gabriele, Chen, Thomas Y., Duarte, Javier, Feickert, Matthew, Graham, Matthew, Gray, Lindsey, Hackett, Dan, Harris, Phil, Hsu, Shih-Chieh, Kasieczka, Gregor, Khoda, Elham E., Komm, Matthias, Liu, Mia, Neubauer, Mark S., Norberg, Scarlet, Perloff, Alexx, Rieger, Marcel, Savard, Claire, Terao, Kazuhiro, Thais, Savannah, Roy, Avik, Vlimant, Jean-Roch, Chachamis, Grigorios
The growing role of data science (DS) and machine learning (ML) in high-energy physics (HEP) is well established and pertinent given the complex detectors, large data, sets and sophisticated analyses at the heart of HEP research. Moreover, exploiting symmetries inherent in physics data have inspired physics-informed ML as a vibrant sub-field of computer science research. HEP researchers benefit greatly from materials widely available materials for use in education, training and workforce development. They are also contributing to these materials and providing software to DS/ML-related fields. Increasingly, physics departments are offering courses at the intersection of DS, ML and physics, often using curricula developed by HEP researchers and involving open software and data used in HEP. In this white paper, we explore synergies between HEP research and DS/ML education, discuss opportunities and challenges at this intersection, and propose community activities that will be mutually beneficial.
AWS Machine Learning Engineer Scholarship Program
AWS and Udacity are collaborating to educate developers of all skill levels on machine learning concepts. We invite learners globally 18 years of age or older who are interested in expanding their machine learning skills and expertise to enroll in the AWS Machine Learning Engineer Scholarship Program. The goal for this program is to up-level machine learning skills to all, and to cultivate the next generation of ML leaders across the world, with a focus on underrepresented groups. Through its We Power Tech Program, AWS collaborates with professional organizations that are leading initiatives to increase the diversity and talent in technical roles, including organizations like Girls In Tech and the National Society of Black Engineers. The scholarship is open to all for registration starting June 21, 2022.
Top reasons to use AI in education - The Bulletin Time
Today we are witnessing a collision of three areas – data, computing and education – which has far-reaching consequences and raises fundamental questions about the very nature of education: what to teach and how to teach. The use of artificial intelligence allows you to redistribute the resources of the teacher. In the traditional model of education, there is a serious problem of uneven distribution of teachers, which also leads to uneven and unequal education. By investing in AI education, teachers around the world can turn their own resources into curriculum. Everywhere in the world, children use the same educational resources.
Towards a General Pre-training Framework for Adaptive Learning in MOOCs
Zhong, Qingyang, Yu, Jifan, Zhang, Zheyuan, Mao, Yiming, Wang, Yuquan, Lin, Yankai, Hou, Lei, Li, Juanzi, Tang, Jie
Adaptive learning aims to stimulate and meet the needs of individual learners, which requires sophisticated system-level coordination of diverse tasks, including modeling learning resources, estimating student states, and making personalized recommendations. Existing deep learning methods have achieved great success over statistical models; however, they still lack generalization for diverse tasks and suffer from insufficient capacity since they are composed of highly-coupled task-specific architectures and rely on small-scale, coarse-grained recommendation scenarios. To realize the idea of general adaptive systems proposed in pedagogical theory, with the emerging pre-training techniques in NLP, we try to conduct a practical exploration on applying pre-training to adaptive learning, to propose a unified framework based on data observation and learning style analysis, properly leveraging heterogeneous learning elements. Through a series of downstream tasks of Learning Recommendation, Learning Resource Evaluation, Knowledge Tracing, and Dropout Prediction, we find that course structures, text, and knowledge are helpful for modeling and inherently coherent to student non-sequential learning behaviors and that indirectly relevant information included in the pre-training foundation can be shared across downstream tasks to facilitate effectiveness. We finally build a simplified systematic application of adaptive learning and reflect on the insights brought back to pedagogy. The source code and dataset will be released.
RESAM: Requirements Elicitation and Specification for Deep-Learning Anomaly Models with Applications to UAV Flight Controllers
Islam, Md Nafee Al, Ma, Yihong, Granadeno, Pedro Alarcon, Chawla, Nitesh, Cleland-Huang, Jane
CyberPhysical systems (CPS) must be closely monitored to identify and potentially mitigate emergent problems that arise during their routine operations. However, the multivariate time-series data which they typically produce can be complex to understand and analyze. While formal product documentation often provides example data plots with diagnostic suggestions, the sheer diversity of attributes, critical thresholds, and data interactions can be overwhelming to non-experts who subsequently seek help from discussion forums to interpret their data logs. Deep learning models, such as Long Short-term memory (LSTM) networks can be used to automate these tasks and to provide clear explanations of diverse anomalies detected in real-time multivariate data-streams. In this paper we present RESAM, a requirements process that integrates knowledge from domain experts, discussion forums, and formal product documentation, to discover and specify requirements and design definitions in the form of time-series attributes that contribute to the construction of effective deep learning anomaly detectors. We present a case-study based on a flight control system for small Uncrewed Aerial Systems and demonstrate that its use guides the construction of effective anomaly detection models whilst also providing underlying support for explainability. RESAM is relevant to domains in which open or closed online forums provide discussion support for log analysis.
How Does Natural Lasoftwarenguage Understanding (NLU) Work?
By the end of this guide, you will learn everything you need to know about how Natural language understanding works & what it means for the future of mankind. Natural language understanding is one of the most important innovations in AI at this time because it allows machines to be able to communicate more naturally with humans! NLU is a subset of artificial intelligence (AI), which seeks to create machines that can think and act in ways that are similar to humans. "While many people view AI as the catalyst to the destruction of mankind as we know it, I still believe technology will be the solution to many of the world's most life-altering problems. By understanding machines and how they work, we can better equip ourselves if there is indeed ever a threat to what we cherish the most."