Goto

Collaborating Authors

 Education


Emergence of Hierarchical Emotion Organization in Large Language Models

arXiv.org Artificial Intelligence

As large language models (LLMs) increasingly power conversational agents, understanding how they model users' emotional states is critical for ethical deployment. Inspired by emotion wheels -- a psychological framework that argues emotions organize hierarchically -- we analyze probabilistic dependencies between emotional states in model outputs. We find that LLMs naturally form hierarchical emotion trees that align with human psychological models, and larger models develop more complex hierarchies. We also uncover systematic biases in emotion recognition across socioeconomic personas, with compounding misclassifications for intersectional, underrepresented groups. Human studies reveal striking parallels, suggesting that LLMs internalize aspects of social perception. Beyond highlighting emergent emotional reasoning in LLMs, our results hint at the potential of using cognitively-grounded theories for developing better model evaluations.


Findings of the BEA 2025 Shared Task on Pedagogical Ability Assessment of AI-powered Tutors

arXiv.org Artificial Intelligence

This shared task has aimed to assess pedagogical abilities of AI tutors powered by large language models (LLMs), focusing on evaluating the quality of tutor responses aimed at student's mistake remediation within educational dialogues. The task consisted of five tracks designed to automatically evaluate the AI tutor's performance across key dimensions of mistake identification, precise location of the mistake, providing guidance, and feedback actionability, grounded in learning science principles that define good and effective tutor responses, as well as the track focusing on detection of the tutor identity. The task attracted over 50 international teams across all tracks. The submitted models were evaluated against gold-standard human annotations, and the results, while promising, show that there is still significant room for improvement in this domain: the best results for the four pedagogical ability assessment tracks range between macro F1 scores of 58.34 (for providing guidance) and 71.81 (for mistake identification) on three-class problems, with the best F1 score in the tutor identification track reaching 96.98 on a 9-class task. In this paper, we overview the main findings of the shared task, discuss the approaches taken by the teams, and analyze their performance. All resources associated with this task are made publicly available to support future research in this critical domain.


Acquiring and Adapting Priors for Novel Tasks via Neural Meta-Architectures

arXiv.org Artificial Intelligence

The ability to transfer knowledge from prior experiences to novel tasks stands as a pivotal capability of intelligent agents, including both humans and computational models. This principle forms the basis of transfer learning, where large pre-trained neural networks are fine-tuned to adapt to downstream tasks. Transfer learning has demonstrated tremendous success, both in terms of task adaptation speed and performance. However there are several domains where, due to lack of data, training such large pre-trained models or foundational models is not a possibility - computational chemistry, computational immunology, and medical imaging are examples. To address these challenges, our work focuses on designing architectures to enable efficient acquisition of priors when large amounts of data are unavailable. In particular, we demonstrate that we can use neural memory to enable adaptation on non-stationary distributions with only a few samples. Then we demonstrate that our hypernetwork designs (a network that generates another network) can acquire more generalizable priors than standard networks when trained with Model Agnostic Meta-Learning (MAML). Subsequently, we apply hypernetworks to 3D scene generation, demonstrating that they can acquire priors efficiently on just a handful of training scenes, thereby leading to faster text-to-3D generation. We then extend our hypernetwork framework to perform 3D segmentation on novel scenes with limited data by efficiently transferring priors from earlier viewed scenes. Finally, we repurpose an existing molecular generative method as a pre-training framework that facilitates improved molecular property prediction, addressing critical challenges in computational immunology.


CLA: Latent Alignment for Online Continual Self-Supervised Learning

arXiv.org Artificial Intelligence

Self-supervised learning (SSL) is able to build latent representations that generalize well to unseen data. However, only a few SSL techniques exist for the online CL setting, where data arrives in small minibatches, the model must comply with a fixed computational budget, and task boundaries are absent. We introduce Continual Latent Alignment (CLA), a novel SSL strategy for Online CL that aligns the representations learned by the current model with past representations to mitigate forgetting. We found that our CLA is able to speed up the convergence of the training process in the online scenario, outperforming state-of-the-art approaches under the same computational budget. Surprisingly, we also discovered that using CLA as a pretraining protocol in the early stages of pretraining leads to a better final performance when compared to a full i.i.d. pretraining.


EXPO: Stable Reinforcement Learning with Expressive Policies

arXiv.org Artificial Intelligence

We study the problem of training and fine-tuning expressive policies with online reinforcement learning (RL) given an offline dataset. Training expressive policy classes with online RL present a unique challenge of stable value maximization. Unlike simpler Gaussian policies commonly used in online RL, expressive policies like diffusion and flow-matching policies are parameterized by a long denoising chain, which hinders stable gradient propagation from actions to policy parameters when optimizing against some value function. Our key insight is that we can address stable value maximization by avoiding direct optimization over value with the expressive policy and instead construct an on-the-fly RL policy to maximize Q-value. We propose Expressive Policy Optimization (EXPO), a sample-efficient online RL algorithm that utilizes an on-the-fly policy to maximize value with two parameterized policies -- a larger expressive base policy trained with a stable imitation learning objective and a light-weight Gaussian edit policy that edits the actions sampled from the base policy toward a higher value distribution. The on-the-fly policy optimizes the actions from the base policy with the learned edit policy and chooses the value maximizing action from the base and edited actions for both sampling and temporal-difference (TD) backup. Our approach yields up to 2-3x improvement in sample efficiency on average over prior methods both in the setting of fine-tuning a pretrained policy given offline data and in leveraging offline data to train online.


What It's Like to Be a Student Who Hates ChatGPT

Slate

Sign up for the Slatest to get the most insightful analysis, criticism, and advice out there, delivered to your inbox daily. As a classically trained singer preparing for a professional career, Erin Perry can see quite clearly how artificial intelligence is upending her field--all the way down to the classroom. Perry just completed her first year as a graduate student in voice performance at the Peabody Institute, the prestigious music conservatory run by Johns Hopkins University. It's been rewarding so far: She's been learning how to navigate the modern classical music sector and confronting the relevant impacts of generative A.I., having taken on a project to study the major record labels' lawsuit against the Amazon-backed A.I. startup Anthropic, which trained its models on songwriters' lyrics sans permission or compensation. Understandably, Perry's rather skeptical of A.I.'s artistic applications, and fearful of the sweeping effects it could have on her chosen field, especially as generative-music startups like Suno and Udio are programmed to replicate specific artists and musical styles.


The Download: combating audio deepfakes, and AI in the classroom

MIT Technology Review

The news: A new technique known as "machine unlearning" could be used to teach AI models to forget specific voices. How it works: Currently, companies tend to deal with this issue by checking whether the prompts or the AI's responses contain disallowed material. Machine unlearning instead asks whether an AI can be made to forget a piece of information that the company doesn't want it to know. It works by taking a model and the specific data to be redacted then using them to create a new model--essentially, a version of the original that never learned that piece of data. Why it matters: This could be an important step in stopping the rise of audio deepfakes, where someone's voice is copied to carry out fraud or scams.


AI text-to-speech programs could "unlearn" how to imitate certain people

MIT Technology Review

AI companies generally keep a tight grip on their models to discourage misuse. For example, if you ask ChatGPT to give you someone's phone number or instructions for doing something illegal, it will likely just tell you it cannot help. However, as many examples over time have shown, clever prompt engineering or model fine-tuning can sometimes get these models to say things they otherwise wouldn't. The unwanted information may still be hiding somewhere inside the model so that it can be accessed with the right techniques. At present, companies tend to deal with this issue by applying guardrails; the idea is to check whether the prompts or the AI's responses contain disallowed material.


New study reveals threats to the Class of 2025. Fixing them should be Job No. 1 for America

FOX News

FOX Business' Taylor Riggs joins'Fox & Friends' to discuss her take on the June jobs report, Democrats' attacks against the legislation and why they claim it will target Medicaid. This summer should be bringing the Class of 2025 a moment of well-deserved relaxation before they launch their careers. Instead, far too many college and high-school graduates are filled with anxiety. They've applied for dozens, perhaps hundreds, of jobs, but interviews and offers have become increasingly rare. The national unemployment rate for young adults aged 20 to 24 looking for work is 6.6% -- the highest level in a decade, excluding the pandemic unemployment spike.


AI's giants want to take over the classroom

MIT Technology Review

The companies could face an uphill battle. Right now, most of the public perceives AI's use in the classroom as nothing short of ruinous--a surefire way to dampen critical thinking and hasten the decline of our collective attention span (a viral story from New York magazine, for example, described how easy it now is to coast through college thanks to constant access to ChatGPT). Amid that onslaught, AI companies insist that AI promises more individualized learning, faster and more creative lesson planning, and quicker grading. The companies sponsoring this initiative are, of course, not doing it out of the goodness of their hearts. No--as they hunt for profits, their goal is to make users out of teachers and students.