Goto

Collaborating Authors

 Education


Promoting Online Safety by Simulating Unsafe Conversations with LLMs

arXiv.org Artificial Intelligence

Generative AI, including large language models (LLMs) have the potential -- and already are being used -- to increase the speed, scale, and types of unsafe conversations online. LLMs lower the barrier for entry for bad actors to create unsafe conversations in particular because of their ability to generate persuasive and human-like text. In our current work, we explore ways to promote online safety by teaching people about unsafe conversations that can occur online with and without LLMs. We build on prior work that shows that LLMs can successfully simulate scam conversations. We also leverage research in the learning sciences that shows that providing feedback on one's hypothetical actions can promote learning. In particular, we focus on simulating scam conversations using LLMs. Our work incorporates two LLMs that converse with each other to simulate realistic, unsafe conversations that people may encounter online between a scammer LLM and a target LLM but users of our system are asked provide feedback to the target LLM.


Agent-centric learning: from external reward maximization to internal knowledge curation

arXiv.org Artificial Intelligence

The pursuit of general intelligence has traditionally centered on external objectives: an agent's control over its environments or mastery of specific tasks. This external focus, however, can produce specialized agents that lack adaptability. We propose representational empowerment, a new perspective towards a truly agent-centric learning paradigm by moving the locus of control inward. This objective measures an agent's ability to controllably maintain and diversify its own knowledge structures. We posit that the capacity -- to shape one's own understanding -- is an element for achieving better ``preparedness'' distinct from direct environmental influence. Focusing on internal representations as the main substrate for computing empowerment offers a new lens through which to design adaptable intelligent systems.


How invisibility cloaks could make us disappear – at least from AI

New Scientist

The desire to disappear has been strong throughout history. It didn't go well for the protagonist in H. G. Wells's The Invisible Man, but that is because his invisibility was permanent. What was needed – and what was longed for – was a means of disappearing temporarily, as popularised by Harry Potter's invisibility cloak. Metamaterials developed in the early 21st century gave hope that a garment offering universal invisibility was feasible. But while some forms of cloaking device did become possible, the sheer level of engineering required to produce them meant they remained rare, ultra-expensive and out of reach to the vast majority.


The Download: a 30-year old baby, and OpenAI's push into colleges

MIT Technology Review

A baby boy has just won the new record for the "oldest baby." Thaddeus Daniel Pierce, who arrived on July 26, developed from an embryo that had been in storage for 30 and a half years. Lindsey and her husband, Tim Pierce, who live in London, Ohio, "adopted" the embryo from Linda Archerd, who had it created in 1994. The couple, aged 35 and 34, respectively, had been trying for a baby for seven years. OpenAI is launching Study Mode, a version of ChatGPT for college students that it promises will act less like a lookup tool and more like a friendly, always-available tutor.


A Study on Variants of Conventional, Fuzzy, and Nullspace-Based Independence Criteria for Improving Supervised and Unsupervised Learning

arXiv.org Machine Learning

-- Unsupervised and supervised learning methods conventionally use kernels to capture nonlinearities inherent in data structure. However experts have to ensure their proposed nonlinearity maximizes variability and capture inherent diversity of data. We revie wed all independenc e criteria to design unsupervised learners. Then we proposed 3 independence criteria and used them to design unsupervised and supervised dimensionality reduction methods. We evaluated contrast, accuracy and interpretability of these meth ods in both linear and neural nonlinear settings. The results show that the methods have outperformed the baseline (tSNE, PCA, regularized LDA, VAE with (un)supervised learner and layer sharing) and opened a new line of interpretable machine learning (ML) for the researchers. Small amount of research is conducted on the role and nature of statistical independence for Machine Learning (ML). Independency criteria are mainly used in the context of Independent Component Analysis (ICA). However learning more about capability of them, gives a wide variety of tools for processing and interpreting supervised and unsupervised learning. As uncorrelatedness is a specific type of independence (linear independence), most of PCA - based approaches gets summariz ed into a special case of independenc y . Another insight about independenc e is the mechanism of Linear Discriminant Analysis (LDA) [15], Independent Component Analysis ( ICA) [1], and Variational Autoencoder ( VAE) [13] based on independency criteria. LDA seeks for a linear projection with least between - class and highest within - class linear dependence. ICA seeks for an unmixing matrix with least statistical dependency between projected components. Finally, VAE seeks for a nonlinear projection to mixtures with minimum correlation (linear independency), minimum mean, and agreed variance. Yet, despite proposing many variations of Kernel PCA [ 1, 19 ] (least between sample dependency criterion), there is no publication in liter ature with neural version of PCA and LDA.


Automatic Classification of User Requirements from Online Feedback -- A Replication Study

arXiv.org Artificial Intelligence

Natural language processing (NLP) techniques have been widely applied in the requirements engineering (RE) field to support tasks such as classification and ambiguity detection. Although RE research is rooted in empirical investigation, it has paid limited attention to replicating NLP for RE (NLP4RE) studies. The rapidly advancing realm of NLP is creating new opportunities for efficient, machine-assisted workflows, which can bring new perspectives and results to the forefront. Thus, we replicate and extend a previous NLP4RE study (baseline), "Classifying User Requirements from Online Feedback in Small Dataset Environments using Deep Learning", which evaluated different deep learning models for requirement classification from user reviews. We reproduced the original results using publicly released source code, thereby helping to strengthen the external validity of the baseline study. We then extended the setup by evaluating model performance on an external dataset and comparing results to a GPT-4o zero-shot classifier. Furthermore, we prepared the replication study ID-card for the baseline study, important for evaluating replication readiness. Results showed diverse reproducibility levels across different models, with Naive Bayes demonstrating perfect reproducibility. In contrast, BERT and other models showed mixed results. Our findings revealed that baseline deep learning models, BERT and ELMo, exhibited good generalization capabilities on an external dataset, and GPT-4o showed performance comparable to traditional baseline machine learning models. Additionally, our assessment confirmed the baseline study's replication readiness; however missing environment setup files would have further enhanced readiness. We include this missing information in our replication package and provide the replication study ID-card for our study to further encourage and support the replication of our study.


UserBench: An Interactive Gym Environment for User-Centric Agents

arXiv.org Artificial Intelligence

Large Language Models (LLMs)-based agents have made impressive progress in reasoning and tool use, enabling them to solve complex tasks. However, their ability to proactively collaborate with users, especially when goals are vague, evolving, or indirectly expressed, remains underexplored. To address this gap, we introduce UserBench, a user-centric benchmark designed to evaluate agents in multi-turn, preference-driven interactions. UserBench features simulated users who start with underspecified goals and reveal preferences incrementally, requiring agents to proactively clarify intent and make grounded decisions with tools. Our evaluation of leading open- and closed-source LLMs reveals a significant disconnect between task completion and user alignment. For instance, models provide answers that fully align with all user intents only 20% of the time on average, and even the most advanced models uncover fewer than 30% of all user preferences through active interaction. These results highlight the challenges of building agents that are not just capable task executors, but true collaborative partners. UserBench offers an interactive environment to measure and advance this critical capability.


Post-Training Large Language Models via Reinforcement Learning from Self-Feedback

arXiv.org Artificial Intelligence

Large Language Models (LLMs) often produce plausible but poorly-calibrated answers, limiting their reliability on reasoning-intensive tasks. We present Reinforcement Learning from Self-Feedback (RLSF), a post-training stage that uses the model's own confidence as an intrinsic reward, mimicking how humans learn in the absence of external feedback. After a frozen LLM generates several chain-of-thought solutions, we define and compute the confidence of each final answer span and rank the traces accordingly. These synthetic preferences are then used to fine-tune the policy with standard preference optimization, similar to RLHF yet requiring no human labels, gold answers, or externally curated rewards. RLSF simultaneously (i) refines the model's probability estimates -- restoring well-behaved calibration -- and (ii) strengthens step-by-step reasoning, yielding improved performance on arithmetic reasoning and multiple-choice question answering. By turning a model's own uncertainty into useful self-feedback, RLSF affirms reinforcement learning on intrinsic model behaviour as a principled and data-efficient component of the LLM post-training pipeline and warrents further research in intrinsic rewards for LLM post-training.


Interactive Adversarial Testing of Autonomous Vehicles with Adjustable Confrontation Intensity

arXiv.org Artificial Intelligence

--Scientific testing techniques are essential for ensuring the safe operation of autonomous vehicles (A Vs), with high-risk, highly interactive scenarios being a primary focus. T o address the limitations of existing testing methods, such as their heavy reliance on high-quality test data, weak interaction capabilities, and low adversarial robustness, this paper proposes ExamPPO, an interactive adversarial testing framework that enables scenario-adaptive and intensity-controllable evaluation of autonomous vehicles. The framework models the Surrounding V ehicle (SV) as an intelligent examiner, equipped with a multi-head attention-enhanced policy network, enabling context-sensitive and sustained behavioral interventions. A scalar confrontation factor is introduced to modulate the intensity of adversarial behaviors, allowing continuous, fine-grained adjustment of test difficulty. Coupled with structured evaluation metrics, ExamPPO systematically probes A V's robustness across diverse scenarios and strategies. Extensive experiments across multiple scenarios and A V strategies demonstrate that ExamPPO can effectively modulate adversarial behavior, expose decision-making weaknesses in tested A Vs, and generalize across heterogeneous environments, thereby offering a unified and reproducible solution for evaluating the safety and intelligence of autonomous decision-making systems. UTONOMOUS driving technologies have achieved substantial progress in recent years, driven by advances in perception, planning, and control systems [1], [2], [3]. These innovations have accelerated the development and deployment of intelligent vehicles in structured and semi-structured environments. This work is supported in part by the National Natural Science Foundation of China (52472451, 62433014), the Shanghai Scientific Innovation Foundation (No.23DZ1203400), and the Fundamental Research Funds for the Central Universities. Yicheng Guo, Chengkai Xu, Peng Hang, and Jian Sun are with the College of Transportation, Tongji University, Shanghai 201804, China.


Can the current trends of AI handle a full course of mathematics?

arXiv.org Artificial Intelligence

This paper addresses the question of how able the current trends of Artificial Intelligence (AI) are in managing to take the responsibility of a full course of mathematics at a college level. The study evaluates this ability in four significant aspects, namely, creating a course syllabus, presenting selected material, answering student questions, and creating an assessment. It shows that even though the AI is strong in some important parts like organization and accuracy, there are still some human aspects that are far away from the current abilities of AI. There is still a hidden emotional part, even in science, that cannot be fulfilled by the AI in its current state. This paper suggests some recommendations to integrate the human and AI potentials to create better outcomes in terms of reaching the target of creating a full course of mathematics, at a university level, as best as possible.