Goto

Collaborating Authors

 Education


Towards Modeling and Influencing the Dynamics of Human Learning

arXiv.org Artificial Intelligence

Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to underestimate a robot's inertia. Nevertheless, these models change and improve over time as humans gather more experience. Interestingly, robot actions influence what this experience is, and therefore influence how people's internal models change. In this work we take a step towards enabling robots to understand the influence they have, leverage it to better assist people, and help human models more quickly align with reality. Our key idea is to model the human's learning as a nonlinear dynamical system which evolves the human's internal model given new observations. We formulate a novel optimization problem to infer the human's learning dynamics from demonstrations that naturally exhibit human learning. We then formalize how robots can influence human learning by embedding the human's learning dynamics model into the robot planning problem. Although our formulations provide concrete problem statements, they are intractable to solve in full generality. We contribute an approximation that sacrifices the complexity of the human internal models we can represent, but enables robots to learn the nonlinear dynamics of these internal models. We evaluate our inference and planning methods in a suite of simulated environments and an in-person user study, where a 7DOF robotic arm teaches participants to be better teleoperators. While influencing human learning remains an open problem, our results demonstrate that this influence is possible and can be helpful in real human-robot interaction.


Hypernetworks for Zero-shot Transfer in Reinforcement Learning

arXiv.org Artificial Intelligence

In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta RL, contextual RL, and transfer learning, with a particular focus on zero-shot performance at test time, enabled by knowledge of the task parameters (also known as context). Our technical approach is based upon viewing each RL algorithm as a mapping from the MDP specifics to the near-optimal value function and policy and seek to approximate it with a hypernetwork that can generate near-optimal value functions and policies, given the parameters of the MDP. We show that, under certain conditions, this mapping can be considered as a supervised learning problem. We empirically evaluate the effectiveness of our method for zero-shot transfer to new reward and transition dynamics on a series of continuous control tasks from DeepMind Control Suite. Our method demonstrates significant improvements over baselines from multitask and meta RL approaches.


Multidimensional Item Response Theory in the Style of Collaborative Filtering

arXiv.org Artificial Intelligence

This paper presents a machine learning approach to multidimensional item response theory (MIRT), a class of latent factor models that can be used to model and predict student performance from observed assessment data. Inspired by collaborative filtering, we define a general class of models that includes many MIRT models. We discuss the use of penalized joint maximum likelihood (JML) to estimate individual models and cross-validation to select the best performing model. This model evaluation process can be optimized using batching techniques, such that even sparse large-scale data can be analyzed efficiently. We illustrate our approach with simulated and real data, including an example from a massive open online course (MOOC). The high-dimensional model fit to this large and sparse dataset does not lend itself well to traditional methods of factor interpretation. By analogy to recommender-system applications, we propose an alternative "validation" of the factor model, using auxiliary information about the popularity of items consulted during an open-book exam in the course.


Distributed Machine Learning for UAV Swarms: Computing, Sensing, and Semantics

arXiv.org Artificial Intelligence

Unmanned aerial vehicle (UAV) swarms are considered as a promising technique for next-generation communication networks due to their flexibility, mobility, low cost, and the ability to collaboratively and autonomously provide services. Distributed learning (DL) enables UAV swarms to intelligently provide communication services, multi-directional remote surveillance, and target tracking. In this survey, we first introduce several popular DL algorithms such as federated learning (FL), multi-agent Reinforcement Learning (MARL), distributed inference, and split learning, and present a comprehensive overview of their applications for UAV swarms, such as trajectory design, power control, wireless resource allocation, user assignment, perception, and satellite communications. Then, we present several state-of-the-art applications of UAV swarms in wireless communication systems, such us reconfigurable intelligent surface (RIS), virtual reality (VR), semantic communications, and discuss the problems and challenges that DL-enabled UAV swarms can solve in these applications. Finally, we describe open problems of using DL in UAV swarms and future research directions of DL enabled UAV swarms. In summary, this survey provides a comprehensive survey of various DL applications for UAV swarms in extensive scenarios.


What is Cognitive Computing? An Architecture and State of The Art

arXiv.org Artificial Intelligence

Cognitive Computing (COC) aims to build highly cognitive machines with low computational resources that respond in real-time. However, scholarly literature shows varying research areas and various interpretations of COC. This calls for a cohesive architecture that delineates the nature of COC. We argue that if Herbert Simon considered the design science is the science of artificial, cognitive systems are the products of cognitive science or 'the newest science of the artificial'. Therefore, building a conceptual basis for COC is an essential step into prospective cognitive computing-based systems. This paper proposes an architecture of COC through analyzing the literature on COC using a myriad of statistical analysis methods. Then, we compare the statistical analysis results with previous qualitative analysis results to confirm our findings. The study also comprehensively surveys the recent research on COC to identify the state of the art and connect the advances in varied research disciplines in COC. The study found that there are three underlaying computing paradigms, Von-Neuman, Neuromorphic Engineering and Quantum Computing, that comprehensively complement the structure of cognitive computation. The research discuss possible applications and open research directions under the COC umbrella.


[100%OFF] SEO Training: Complete SEO Course & SEO Copywriting MASTERY

#artificialintelligence

This SEO Course & SEO Copywriting Course is Completely Updated for 2022 with 100 Interactive Quizzes, Writing Assignments, Animated Videos, Link Building Strategies, E-commerce Copywriting Templates & 210 SEO Ranking Factors making learning Enjoyable & Fun. Hi, Tomas Moravek here, Internet Efficiency 2016 Award Winning Digital Strategist, to introduce my brand new, updated, SEO & Copywriting MASTERY Course. I've put so much passion, energy, and time in to creating this SEO Training for you and I can't wait until you join my thousands of satisfied students so you can see for yourself why my strategies really work. White Hat SEO tactics are the most effective as they comply with the major search engine's terms and conditions and have been fully approved by them. Not only that, they focus on a human audience as opposed to search engines, so are far more effective at organically growing your reach than Black Hat or Grey Hat techniques.


Progress in Emotion Recognition part3(Computer Vision)

#artificialintelligence

Abstract: Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden emotion state. However, even as humans, and despite our empathy and familiarity with the human emotional experience, we are only able to guess what the other might be feeling. In the fields of artificial intelligence and computer vision, Facial Emotion Recognition (FER) is a topic that is still in full growth mostly with the advancement of deep learning approaches and the improvement of data collection. The main purpose of this paper is to compare the performance of three state-of-the-art networks, each having their own approach to improve on FER tasks, on three FER datasets.


How AI-enabled initiatives have impacted these Indian sectors in 2022 - India Today

#artificialintelligence

By Nidhi Bhardwaj: In India, public funding for the Digital India mission increased by 67 percent from last year to Rs10,676 crores in 2022-23; the mission outlines a plan to use AI to promote financial inclusion, supplement the education sector, and transform urban infrastructure. States such as Tamil Nadu, Punjab, Uttar Pradesh, and Telangana are already utilising AI-based tools to support law and order, increase agricultural productivity, and improve health care delivery. The AI market in India is expected to grow at a CAGR (compound annual growth rate) of 20.2 percent to $7.8 billion by 2025. Startups in India have contributed to India's GDP in addition to government initiatives. Experts believe that AI will account for 400-500 billion dollars in India's GDP by 2025, accounting for 10 percent of the country's $5 trillion GDP target.


Statistics For Data Science and Machine Learning with Python

#artificialintelligence

This course is ideal for you if you want to gain knowledge in statistical methods required for Data Science and machine learning! Learning Statistics is an essential part of becoming a professional data scientist. Most data science learners study python for data science and ignore or postpone studying statistics. One reason for that is the lack of resources and courses that teach statistics for data science and machine learning. Statistics is a huge field of science, but the good news for data science learners is that not all statistics are required for data science and machine learning.


Artificial Intelligence: Reinforcement Learning In Python - AI Summary

#artificialintelligence

Learning about supervised and unsupervised machine learning is no small feat. As you'll learn in this course, the reinforcement learning paradigm is more different from supervised and unsupervised learning than they are from each other. If you're ready to take on a brand new challenge, and learn about AI techniques that you've never seen before in traditional supervised machine learning, unsupervised machine learning, or even deep learning, then this course is for you.