Education
Digital resurrection: fascination and fear over the rise of the deathbot
Rod Stewart had a few surprise guests at a recent concert in Charlotte, North Carolina. His old friend Ozzy Osbourne, the lead singer of Black Sabbath who died last month, was apparently beamed in from some kind of rock heaven, where he was reunited with other departed stars including Michael Jackson, Tina Turner and Bob Marley. The AI-generated images divided Stewart's fans. Some denounced them as disrespectful and distasteful; others found the tribute beautiful. At about the same time, another AI controversy erupted when Jim Acosta, a former CNN White House correspondent, interviewed a digital recreation of Joaquin Oliver, who was killed at the age of 17 in a 2018 high school shooting in Florida.
Texas company creates drones to confront school shooters in seconds
Campus Guardian Angel founder and CEO Justin Marston tells'Fox & Friends First' about his Texas-based company's drones designed to make schools safer by confronting an active shooter within seconds. A drone system designed to confront a school shooter within seconds could soon become a frontline defense in classrooms across America. Texas-based Campus Guardian Angel has developed the technology which stations drones inside schools, ready to deploy the moment an emergency alert is triggered. The drones, all controlled remotely at a central operation center in Austin, Texas, are stored in charging boxes inside schools. Once activated, they are designed to fire powder pellets to incapacitate a shooter within 60 seconds and buy time for local law enforcement to arrive at the scene.
When a journalist uses AI to interview a dead child, isn't it time to ask what the boundaries should be? Gaby Hinsliff
Joaquin Oliver was 17 years old when he was shot in the hallway of his high school. An older teenager, expelled some months previously, had opened fire with a high-powered rifle on Valentine's Day in what became America's deadliest high school shooting. Seven years on, Joaquin says he thinks it's important to talk about what happened on that day in Parkland, Florida, "so that we can create a safer future for everyone". But sadly, what happened to Joaquin that day is that he died. The oddly metallic voice speaking to the ex-CNN journalist Jim Acosta in an interview on Substack this week was actually that of a digital ghost: an AI, trained on the teenager's old social media posts at the request of his parents, who are using it to bolster their campaign for tougher gun controls.
Conservative classifiers do consistently well with improving agents: characterizing statistical and online learning
Machine learning is now ubiquitous in societal decision-making, for example in evaluating job candidates or loan applications, and it is increasingly important to take into account how classified agents will react to the learning algorithms. The majority of recent literature on strategic classification has focused on reducing and countering deceptive behaviors by the classified agents, but recent work of Attias et al. identifies surprising properties of learnability when the agents genuinely improve in order to attain the desirable classification, such as smaller generalization error than standard PAC-learning. In this paper we characterize so-called learnability with improvements across multiple new axes. We introduce an asymmetric variant of minimally consistent concept classes and use it to provide an exact characterization of proper learning with improvements in the realizable setting. While prior work studies learnability only under general, arbitrary agent improvement regions, we give positive results for more natural Euclidean ball improvement sets. In particular, we characterize improper learning under a mild generative assumption on the data distribution. We further show how to learn in more challenging settings, achieving lower generalization error under well-studied bounded noise models and obtaining mistake bounds in realizable and agnostic online learning. We resolve open questions posed by Attias et al. for both proper and improper learning.
How Do LLMs Persuade? Linear Probes Can Uncover Persuasion Dynamics in Multi-Turn Conversations
Jaipersaud, Brandon, Krueger, David, Lubana, Ekdeep Singh
Large Language Models (LLMs) have started to demonstrate the ability to persuade humans, yet our understanding of how this dynamic transpires is limited. Recent work has used linear probes, lightweight tools for analyzing model representations, to study various LLM skills such as the ability to model user sentiment and political perspective. Motivated by this, we apply probes to study persuasion dynamics in natural, multi-turn conversations. We leverage insights from cognitive science to train probes on distinct aspects of persuasion: persuasion success, persuadee personality, and persuasion strategy. Despite their simplicity, we show that they capture various aspects of persuasion at both the sample and dataset levels. For instance, probes can identify the point in a conversation where the persuadee was persuaded or where persuasive success generally occurs across the entire dataset. We also show that in addition to being faster than expensive prompting-based approaches, probes can do just as well and even outperform prompting in some settings, such as when uncovering persuasion strategy. This suggests probes as a plausible avenue for studying other complex behaviours such as deception and manipulation, especially in multi-turn settings and large-scale dataset analysis where prompting-based methods would be computationally inefficient.
Simulating Human-Like Learning Dynamics with LLM-Empowered Agents
Yuan, Yu, Zhao, Lili, Chen, Wei, Zheng, Guangting, Zhang, Kai, Zhang, Mengdi, Liu, Qi
Capturing human learning behavior based on deep learning methods has become a major research focus in both psychology and intelligent systems. Recent approaches rely on controlled experiments or rule-based models to explore cognitive processes. However, they struggle to capture learning dynamics, track progress over time, or provide explainability. To address these challenges, we introduce LearnerAgent, a novel multi-agent framework based on Large Language Models (LLMs) to simulate a realistic teaching environment. To explore human-like learning dynamics, we construct learners with psychologically grounded profiles-such as Deep, Surface, and Lazy-as well as a persona-free General Learner to inspect the base LLM's default behavior. Through weekly knowledge acquisition, monthly strategic choices, periodic tests, and peer interaction, we can track the dynamic learning progress of individual learners over a full-year journey. Our findings are fourfold: 1) Longitudinal analysis reveals that only Deep Learner achieves sustained cognitive growth. Our specially designed "trap questions" effectively diagnose Surface Learner's shallow knowledge. 2) The behavioral and cognitive patterns of distinct learners align closely with their psychological profiles. 3) Learners' self-concept scores evolve realistically, with the General Learner developing surprisingly high self-efficacy despite its cognitive limitations. 4) Critically, the default profile of base LLM is a "diligent but brittle Surface Learner"-an agent that mimics the behaviors of a good student but lacks true, generalizable understanding. Extensive simulation experiments demonstrate that LearnerAgent aligns well with real scenarios, yielding more insightful findings about LLMs' behavior.
Conformal Sets in Multiple-Choice Question Answering under Black-Box Settings with Provable Coverage Guarantees
Large Language Models (LLMs) have shown remarkable progress in multiple-choice question answering (MCQA), but their inherent unreliability, such as hallucination and overconfidence, limits their application in high-risk domains. To address this, we propose a frequency-based uncertainty quantification method under black-box settings, leveraging conformal prediction (CP) to ensure provable coverage guarantees. Our approach involves multiple independent samplings of the model's output distribution for each input, with the most frequent sample serving as a reference to calculate predictive entropy (PE). Experimental evaluations across six LLMs and four datasets (MedMCQA, MedQA, MMLU, MMLU-Pro) demonstrate that frequency-based PE outperforms logit-based PE in distinguishing between correct and incorrect predictions, as measured by AUROC. Furthermore, the method effectively controls the empirical miscoverage rate under user-specified risk levels, validating that sampling frequency can serve as a viable substitute for logit-based probabilities in black-box scenarios. This work provides a distribution-free model-agnostic framework for reliable uncertainty quantification in MCQA with guaranteed coverage, enhancing the trustworthiness of LLMs in practical applications.
Streamlining Admission with LOR Insights: AI-Based Leadership Assessment in Online Master's Program
Soylu, Meryem Yilmaz, Gallard, Adrian, Lee, Jeonghyun, Grigoryan, Gayane, Desai, Rushil, Harmon, Stephen
Letters of recommendation (LORs) provide valuable insights into candidates' capabilities and experiences beyond standardized test scores. However, reviewing these text-heavy materials is time-consuming and labor-intensive. To address this challenge and support the admission committee in providing feedback for students' professional growth, our study introduces LORI: LOR Insights, a novel AI-based detection tool for assessing leadership skills in LORs submitted by online master's program applicants. By employing natural language processing and leveraging large language models using RoBERTa and LLAMA, we seek to identify leadership attributes such as teamwork, communication, and innovation. Our latest RoBERTa model achieves a weighted F1 score of 91.6%, a precision of 92.4%, and a recall of 91.6%, showing a strong level of consistency in our test data. With the growing importance of leadership skills in the STEM sector, integrating LORI into the graduate admissions process is crucial for accurately assessing applicants' leadership capabilities. This approach not only streamlines the admissions process but also automates and ensures a more comprehensive evaluation of candidates' capabilities.
Group Causal Policy Optimization for Post-Training Large Language Models
Gu, Ziyin, Wang, Jingyao, Zuo, Ran, Sun, Chuxiong, Song, Zeen, Zheng, Changwen, Qiang, Wenwen
Recent advances in large language models (LLMs) have broadened their applicability across diverse tasks, yet specialized domains still require targeted post training. Among existing methods, Group Relative Policy Optimization (GRPO) stands out for its efficiency, leveraging groupwise relative rewards while avoiding costly value function learning. However, GRPO treats candidate responses as independent, overlooking semantic interactions such as complementarity and contradiction. To address this challenge, we first introduce a Structural Causal Model (SCM) that reveals hidden dependencies among candidate responses induced by conditioning on a final integrated output forming a collider structure. Then, our causal analysis leads to two insights: (1) projecting responses onto a causally informed subspace improves prediction quality, and (2) this projection yields a better baseline than query only conditioning. Building on these insights, we propose Group Causal Policy Optimization (GCPO), which integrates causal structure into optimization through two key components: a causally informed reward adjustment and a novel KL regularization term that aligns the policy with a causally projected reference distribution. Comprehensive experimental evaluations demonstrate that GCPO consistently surpasses existing methods, including GRPO across multiple reasoning benchmarks.