Instructional Material
Computational Models of Solving Raven's Progressive Matrices: A Comprehensive Introduction
As being widely used to measure human intelligence, Raven's Progressive Matrices (RPM) tests also pose a great challenge for AI systems. There is a long line of computational models for solving RPM, starting from 1960s, either to understand the involved cognitive processes or solely for problem-solving purposes. Due to the dramatic paradigm shifts in AI researches, especially the advent of deep learning models in the last decade, the computational studies on RPM have also changed a lot. Therefore, now is a good time to look back at this long line of research. As the title -- ``a comprehensive introduction'' -- indicates, this paper provides an all-in-one presentation of computational models for solving RPM, including the history of RPM, intelligence testing theories behind RPM, item design and automatic item generation of RPM-like tasks, a conceptual chronicle of computational models for solving RPM, which reveals the philosophy behind the technology evolution of these models, and suggestions for transferring human intelligence testing and AI testing.
Sentiment analysis and opinion mining on educational data: A survey
Shaik, Thanveer, Tao, Xiaohui, Dann, Christopher, Xie, Haoran, Li, Yan, Galligan, Linda
Sentiment analysis AKA opinion mining is one of the most widely used NLP applications to identify human intentions from their reviews. In the education sector, opinion mining is used to listen to student opinions and enhance their learning-teaching practices pedagogically. With advancements in sentiment annotation techniques and AI methodologies, student comments can be labelled with their sentiment orientation without much human intervention. In this review article, (1) we consider the role of emotional analysis in education from four levels: document level, sentence level, entity level, and aspect level, (2) sentiment annotation techniques including lexicon-based and corpus-based approaches for unsupervised annotations are explored, (3) the role of AI in sentiment analysis with methodologies like machine learning, deep learning, and transformers are discussed, (4) the impact of sentiment analysis on educational procedures to enhance pedagogy, decision-making, and evaluation are presented. Educational institutions have been widely invested to build sentiment analysis tools and process their student feedback to draw their opinions and insights. Applications built on sentiment analysis of student feedback are reviewed in this study. Challenges in sentiment analysis like multi-polarity, polysemous, negation words, and opinion spam detection are explored and their trends in the research space are discussed. The future directions of sentiment analysis in education are discussed.
2023 AAAI Tutorial: Advances in Neuro Symbolic Reasoning โ Lab V2
This resource page will be updated periodically prior to the event. Over the past five years, the community has made significant advances in neuro symbolic reasoning (NSR). These NSR frameworks are now capable of embedding prior knowledge in deep learning architectures, guiding the learning process with logical constraints, providing symbolic explainability, and using gradient-based approaches to learn logical statements. At this time, several approaches are seeing usage in various application areas. This tutorial is designed for researchers looking to understand the current landscape of NSR research as well as those looking to apply NSR research in areas such as natural language processing and verification.
Data Science Prerequisites - Numpy - Pandas- Seaborn
An excellent choice for both beginners and experts looking to expand their knowledge on one of the most popular Python libraries in the world! If you've spent time in a spreadsheet software like MS Excel or Google Sheets and want to take your data analysis skills to the next level, this course is for you! Pandas is a Python package providing fast, flexible, and expressive data structures designed to make working with "relational" or "labeled" data both easy and intuitive. It aims to be the fundamental high-level building block for doing practical, real-world data analysis in Python. Pandas is the most powerful and flexible open source data analysis/manipulation tool available in any language.
Online Reinforcement Learning with Uncertain Episode Lengths
Mandal, Debmalya, Radanovic, Goran, Gan, Jiarui, Singla, Adish, Majumdar, Rupak
Existing episodic reinforcement algorithms assume that the length of an episode is fixed across time and known a priori. In this paper, we consider a general framework of episodic reinforcement learning when the length of each episode is drawn from a distribution. We first establish that this problem is equivalent to online reinforcement learning with general discounting where the learner is trying to optimize the expected discounted sum of rewards over an infinite horizon, but where the discounting function is not necessarily geometric. We show that minimizing regret with this new general discounting is equivalent to minimizing regret with uncertain episode lengths. We then design a reinforcement learning algorithm that minimizes regret with general discounting but acts for the setting with uncertain episode lengths. We instantiate our general bound for different types of discounting, including geometric and polynomial discounting. We also show that we can obtain similar regret bounds even when the uncertainty over the episode lengths is unknown, by estimating the unknown distribution over time. Finally, we compare our learning algorithms with existing value-iteration based episodic RL algorithms in a grid-world environment.
Online Bayesian Meta-Learning for Cognitive Tracking Radar
Thornton, Charles E., Buehrer, R. Michael, Martone, Anthony F.
A key component of cognitive radar is the ability to generalize, or achieve consistent performance across a range of sensing environments, since aspects of the physical scene may vary over time. This presents a challenge for learning-based waveform selection approaches, since transmission policies which are effective in one scene may be highly suboptimal in another. We address this problem by strategically biasing a learning algorithm by exploiting high-level structure across tracking instances, referred to as meta-learning. In this work, we develop an online meta-learning approach for waveform-agile tracking. This approach uses information gained from previous target tracks to speed up and enhance learning in new tracking instances. This results in sample-efficient learning across a class of finite state target channels by exploiting inherent similarity across tracking scenes, attributed to common physical elements such as target type or clutter statistics. We formulate the online waveform selection problem within the framework of Bayesian learning, and provide prior-dependent performance bounds for the meta-learning problem using Probability Approximately Correct (PAC)-Bayes theory. We present a computationally feasible meta-posterior sampling algorithm and study the performance in a simulation study consisting of diverse scenes. Finally, we examine the potential performance benefits and practical challenges associated with online meta-learning for waveform-agile tracking.
Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling
Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike GPs, NPs and their variants suffer from underfitting and often have intractable likelihoods, which limit their applications in sequential decision making. We propose Transformer Neural Processes (TNPs), a new member of the NP family that casts uncertainty-aware meta learning as a sequence modeling problem. We learn TNPs via an autoregressive likelihood-based objective and instantiate it with a novel transformer-based architecture. The model architecture respects the inductive biases inherent to the problem structure, such as invariance to the observed data points and equivariance to the unobserved points. We further investigate knobs within the TNP framework that tradeoff expressivity of the decoding distribution with extra computation. Empirically, we show that TNPs achieve state-of-the-art performance on various benchmark problems, outperforming all previous NP variants on meta regression, image completion, contextual multi-armed bandits, and Bayesian optimization.
Building a Regression Model in PyTorch - MachineLearningMastery.com Building a Regression Model in PyTorch - MachineLearningMastery.com
PyTorch library is for deep learning. Some applications of deep learning models are to solve regression or classification problems. In this post, you will discover how to use PyTorch to develop and evaluate neural network models for regression problems. The dataset you will use in this tutorial is the California housing dataset. This is a dataset that describes the median house value for California districts.
World University Law School - World University and School Wiki
Welcome to World University and School Wiki which anyone can add to or edit. WUaS would like to offer online CLE credits with these great universities, anticipating accrediting WUaS Law Schools in 204 countries. California, the state in which WUaS is incorporated, has 12 online law schools (none of these are ABA approved, but anyone can sit the California Bar exam, regardless of such approval, as I understand it), at present, and WUaS would like to develop another online MIT OCW/Harvard-centric law school, and eventually accredit in all 204 countries in the world, in main languages in those countries, beginning with the 6 United Nations' languages. Online Law Schools Have Yet to Pass the Bar: Many argue that fully online programs aren't the path to a traditional legal career]. WUaS is planning for a "Admitted Students' Day" for the first, matriculating Bachelor's degree class, on or around Saturday, April 14th, 2014, and the second Saturday of April for other degrees in the future.
Training a Custom Image Classification Network for OAK-D - PyImageSearch
In this tutorial, you will learn to train a custom image classification network for OAK-D using the TensorFlow framework. Furthermore, this tutorial aims to develop an image classification model that can learn to classify one of the 15 vegetables (e.g., tomato, brinjal, and bottle gourd). If you are a regular PyImageSearch reader and have even basic knowledge of Deep Learning in Computer Vision, then this tutorial should be easy to understand. Furthermore, this tutorial acts as a foundation for the following tutorial, where we learn to deploy this trained image classification model on OAK-D. To learn how to train an image classification network for OAK-D, just keep reading. Before we start data loading, analysis, and training the classification network on the data, we must carefully pick the suitable classification architecture as it would finally be deployed on the OAK. Although OAK can process 4 trillion operations per second, it is still an edge device.