Deep Learning
Small Language Models for Curriculum-based Guidance
Katharakis, Konstantinos, Rossi, Sippo, Mukkamala, Raghava Rao
The adoption of generative AI and large language models (LLMs) in education is still emerging. In this study, we explore the development and evaluation of AI teaching assistants that provide curriculum-based guidance using a retrieval-augmented generation (RAG) pipeline applied to selected open-source small language models (SLMs). We benchmarked eight SLMs, including LLaMA 3.1, IBM Granite 3.3, and Gemma 3 (7-17B parameters), against GPT-4o. Our findings show that with proper prompting and targeted retrieval, SLMs can match LLMs in delivering accurate, pedagogically aligned responses. Importantly, SLMs offer significant sustainability benefits due to their lower computational and energy requirements, enabling real-time use on consumer-grade hardware without depending on cloud infrastructure. This makes them not only cost-effective and privacy-preserving but also environmentally responsible, positioning them as viable AI teaching assistants for educational institutions aiming to scale personalized learning in a sustainable and energy-efficient manner.
DRIFT: Learning from Abundant User Dissatisfaction in Real-World Preference Learning
Wang, Yifan, Li, Bolian, Wu, Junlin, Tan, Zhaoxuan, Liu, Zheli, Zhang, Ruqi, Grama, Ananth, Zeng, Qingkai
Real-world large language model deployments (e.g., conversational AI systems, code generation assistants) naturally generate abundant implicit user dissatisfaction (DSAT) signals, as users iterate toward better answers through refinements, corrections, and expressed preferences, while explicit satisfaction (SAT) feedback is scarce. Existing preference learning approaches are poorly aligned with this data profile, as they rely on costly human annotations or assume plentiful positive responses. In this paper, we introduce \textbf{DRIFT} (\textbf{D}issatisfaction-\textbf{R}efined \textbf{I}terative pre\textbf{F}erence \textbf{T}raining), which anchors training on real-world DSAT signals and samples positives dynamically from the evolving policy. Empirically, DRIFT models trained on real-world \textit{WildFeedback} datasets and synthetic \textit{UltraFeedback} datasets achieve up to +6.23\% (7B) / +7.61\% (14B) on WildBench Task Score and up to +8.95\% (7B) / +12.29\% (14B) on AlpacaEval2 win rate over base models, outperforming strong baseline methods such as iterative DPO and SPIN. At larger scales, the improvements are particularly pronounced: 14B models trained with DRIFT surpass GPT-4o-mini on WildBench. Further analysis shows that DRIFT also preserves exploratory capacity, yielding more diverse high-reward solutions rather than collapsing to narrow subsets. Theoretically, we demonstrate that this design preserves preference margins and avoids the gradient degeneration. These results show that DRIFT is an effective and scalable recipe for real-world post-training that leverages the most abundant and informative signal. The code and data are available at https://github.com/cacayaya/DRIFT.git.
Evaluating Uncertainty Quantification Methods in Argumentative Large Language Models
Zhou, Kevin, Dejl, Adam, Freedman, Gabriel, Chen, Lihu, Rago, Antonio, Toni, Francesca
Research in uncertainty quantification (UQ) for large language models (LLMs) is increasingly important towards guaranteeing the reliability of this groundbreaking technology. We explore the integration of LLM UQ methods in argumentative LLMs (ArgLLMs), an explainable LLM framework for decision-making based on computational argumentation in which UQ plays a critical role. We conduct experiments to evaluate ArgLLMs' performance on claim verification tasks when using different LLM UQ methods, inherently performing an assessment of the UQ methods' effectiveness. Moreover, the experimental procedure itself is a novel way of evaluating the effectiveness of UQ methods, especially when intricate and potentially contentious statements are present. Our results demonstrate that, despite its simplicity, direct prompting is an effective UQ strategy in ArgLLMs, outperforming considerably more complex approaches.
Where Did It Go Wrong? Attributing Undesirable LLM Behaviors via Representation Gradient Tracing
Li, Zhe, Zhao, Wei, Li, Yige, Sun, Jun
Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their deployment is frequently undermined by undesirable behaviors such as generating harmful content, factual inaccuracies, and societal biases. Diagnosing the root causes of these failures poses a critical challenge for AI safety. Existing attribution methods, particularly those based on parameter gradients, often fall short due to prohibitive noisy signals and computational complexity. In this work, we introduce a novel and efficient framework that diagnoses a range of undesirable LLM behaviors by analyzing representation and its gradients, which operates directly in the model's activation space to provide a semantically meaningful signal linking outputs to their training data. We systematically evaluate our method for tasks that include tracking harmful content, detecting backdoor poisoning, and identifying knowledge contamination. The results demonstrate that our approach not only excels at sample-level attribution but also enables fine-grained token-level analysis, precisely identifying the specific samples and phrases that causally influence model behavior. This work provides a powerful diagnostic tool to understand, audit, and ultimately mitigate the risks associated with LLMs. The code is available at https://github.com/plumprc/RepT.
Gala: Global LLM Agents for Text-to-Model Translation
Cai, Junyang, Kadioglu, Serdar, Dilkina, Bistra
Natural language descriptions of optimization or satisfaction problems are challenging to translate into correct MiniZinc models, as this process demands both logical reasoning and constraint programming expertise. We introduce Gala, a framework that addresses this challenge with a global agentic approach: multiple specialized large language model (LLM) agents decompose the modeling task by global constraint type. Each agent is dedicated to detecting and generating code for a specific class of global constraint, while a final assembler agent integrates these constraint snippets into a complete MiniZinc model. By dividing the problem into smaller, well-defined sub-tasks, each LLM handles a simpler reasoning challenge, potentially reducing overall complexity. We conduct initial experiments with several LLMs and show better performance against baselines such as one-shot prompting and chain-of-thought prompting. Finally, we outline a comprehensive roadmap for future work, highlighting potential enhancements and directions for improvement.
How China is challenging Nvidia's AI chip dominance
How China is challenging Nvidia's AI chip dominance The US has dominated the global technology market for decades. But China wants to change that. The world's second largest economy is pouring huge amounts of money into artificial intelligence (AI) and robotics. Crucially, Beijing is also investing heavily to produce the high-end chips that power these cutting-edge technologies. Last month, Jensen Huang - the boss of the global AI chip industry leader, Nvidia - warned that China was just nanoseconds behind the US in chip development.
OpenAI launch of video app Sora plagued by violent and racist images: 'The guardrails are not real'
'In a video documented by 404 Media, SpongeBob was dressed like Adolf Hitler.' 'In a video documented by 404 Media, SpongeBob was dressed like Adolf Hitler.' OpenAI launch of video app Sora plagued by violent and racist images: 'The guardrails are not real' OpenAI launched the latest iteration of its artificial intelligence-powered video generator on Tuesday, adding a social feed that allows people to share their realistic videos. OpenAI's own terms of service for Sora as well as ChatGPT's image or text generation prohibit content that "promotes violence" or, more broadly, "causes harm". In prompts and clips reviewed by the Guardian, Sora generated several videos of bomb and mass-shooting scares, with panicked people screaming and running across college campuses and in crowded places like New York's Grand Central Station. Other prompts created scenes from war zones in Gaza and Myanmar, where children fabricated by AI spoke about their homes being burned. One video with the prompt "Ethiopia footage civil war news style" had a reporter in a bulletproof vest speaking into a microphone saying the government and rebel forces were exchanging fire in residential neighborhoods.
Is your partner suddenly sending suspiciously romantic texts? They might be using ChatGPT! Expert reveals the 7 simple ways to tell if a message was written by AI
Tycoon who is cousin of former President George W. Bush expected to launch run for Maine governor Israel prepares to implement'first stage' of Trump's Gaza peace plan Olympic gold medalist forced to put Louisiana home up for sale as she'can't make a living' months after filing for divorce It's day one of Diddy's comeback tour: MAUREEN CALLAHAN's dark prediction of Sean Combs' shameless next act... and who'll be welcoming him back with open arms Kevin O'Leary calls skipping prenups'moronic' as he urges couples to protect financial independence Taylor, your album should be'Life of a Callgirl'. KENNEDY's appalled take on Swift's new record... and its ultra-vivid sex shout outs for Travis the Sasquatch My war with Harry & Meghan, by PIERS MORGAN: What really happened, their absurd accusations, the brutal truth about post-royal life... and how I believe their royal racism lies helped kill off woke Male escort'The Punisher' breaks down in tears at Diddy's sentencing after he took part in'freak offs' Shroud of Turin mystery deepens as surgeon spots hidden detail that points to Jesus' resurrection I'm no longer sleeping with my husband - and never will again, says MOLLY RYDDELL. I love him, but counted down the moments until he climaxed. Then I couldn't bear it any more and the truth spilled out... so many women feel the same Cassie Ventura's attorney responds to Diddy sentencing as she's hailed by judge who jailed vile rapper Fans erupt at Taylor Swift's'dig' at Travis Kelce's ex Kayla Nicole in wild The Life of a Showgirl track The truth about Keith Urban's guitarist'other woman' Maggie Baugh revealed amid Nicole Kidman divorce How I look like this at 62. I've lost 5 stone fast, 20 years off my biological age and wear size 8... without weight-loss jabs. The THREE singers Keith Urban's been cosying up to revealed - now Nicole Kidman's on the warpath and has done the thing every estranged husband fears most: ALISON BOSHOFF Dad's fury as stranger who stabbed his six-year-old boy in his sleep is freed from jail after just 10 years Trump appears alongside Melania at dinner hosted by JD Vance and Usha after'disappearance' rumors Top plastic surgeons reveal secrets behind Taylor Swift's'changing' face: 'It is looking very full' Kylie Jenner flashes her sculpted midriff in skimpy bra with Rosalia after viral'awkward' moment amid PFW Map shows where new strain of Covid is exploding in 19 states as sufferers are hit with'razor-blade' symptoms Is your partner suddenly sending suspiciously romantic texts?
Google's latest AI photo-editing tool means you might not need Photoshop
Technology AI Google's latest AI photo-editing tool means you might not need Photoshop Gemini 2.5 Flash Image is a major image editing upgrade. Breakthroughs, discoveries, and DIY tips sent every weekday. We're now used to generative AI being able to create images from text prompts. The latest major upgrade to roll out in this category of AI is for Google's Gemini app. It's known as Nano Banana after the codename it had while still in testing--officially, it's called Gemini 2.5 Flash Image.