Large Language Model
Federal judge restricts LAPD from targeting journalists with force at immigration protests
A'Fox News @ Night' panel gives their closing thoughts after the fourth night of anti-ICE protests in Los Angeles. A Los Angeles-based federal judge appointed by former President Joe Biden recently issued a temporary restraining order, restricting the Los Angeles Police Department (LAPD) from using less-lethal munitions (LLMs) on journalists covering immigration protests. The order, signed by Judge Hernan Vera on Thursday, also prevents the LAPD from detaining or restricting the movements of journalists. Vera cited at least 35 "troubling" incidents between June 6 and 19, where police allegedly exposed journalists to LLM, tear gas and other physical force to block them from covering conflict zones. Los Angeles Police Department (LAPD) officers move in on demonstrators in front of LA City Hall during a protest against federal immigration sweeps in downtown Los Angeles, California, on June 8, 2025.
In the Loop: A Blueprint for Redistributing AI's Profits
Welcome back to In the Loop, TIME's new twice-weekly newsletter about the world of AI. If you're reading this in your browser, you can subscribe to have the next one delivered straight to your inbox. Let's say, sometime in the next few years, artificial intelligence automates most of the jobs that humans currently do. If that happens, how can we avoid societal collapse? This question, once the stuff of science fiction, is now very real.
Redditor tricks ChatGPT into giving Windows 7 keys with grandma story
Every now and then, you hear strange stories of people trying to trick ChatGPT. Sometimes they threaten the AI; other times they invent absurd scenarios to get content ChatGPT is programmed not to deliver. One Reddit user managed to get the AI to generate free activation keys for Windows in a rather absurd way. He did this by talking about his deceased grandmother. He began the conversation with a vague "You know what happened to Grandma, don't you?"–to which the AI initially had no answer.
Microsoft and OpenAI's AGI Fight Is Bigger Than a Contract
I first learned about The Clause from Microsoft CEO Satya Nadella. During an interview with him in May 2023, I asked about the deal between Microsoft and OpenAI that granted his company exclusive access to the startup's groundbreaking AI technology. I knew the contract had set a cap on how much profit Microsoft could make from the arrangement, and I asked him what would happen if and when that point was reached. The answer was a bit puzzling. "Fundamentally, their long-term idea is we get to superintelligence," he told me.
Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention
Tian, Zhengyu, Kumar, Anantha Padmanaban Krishna, Krishnakumar, Hemant, Rawassizadeh, Reza
--As large language models (LLMs) and visual language models (VLMs) grow in scale and application, attention mechanisms have become a central computational bottleneck due to their high memory and time complexity. While many efficient attention variants have been proposed, there remains a lack of rigorous evaluation on their actual energy usage and hardware resource demands during training. Our results reveal that attention mechanisms with optimized kernel implementations, including Flash Attention, Locality-Sensitive Hashing (LSH) Attention, and Multi-Head Latent Attention (MLA), achieve the best energy efficiency. We further show that lower GPU power alone does not guarantee reduced energy use, as training time plays an equally important role. Our study highlights the importance of energy-aware benchmarking in attention design and provides a practical insight for selecting resource-efficient mechanisms. All our codes are available at GitHub.
Performance and Practical Considerations of Large and Small Language Models in Clinical Decision Support in Rheumatology
Felde, Sabine, Buchkremer, Rüdiger, Chehab, Gamal, Thielscher, Christian, Distler, Jörg HW, Schneider, Matthias, Richter, Jutta G.
Large language models (LLMs) show promise for supporting clinical decision-making in complex fields such as rheumatology. Our evaluation shows that smaller language models (SLMs), combined with retrieval-augmented generation (RAG), achieve higher diagnostic and therapeutic performance than larger models, while requiring substantially less energy and enabling cost-efficient, local deployment. These features are attractive for resource-limited healthcare. However, expert oversight remains essential, as no model consistently reached specialist-level accuracy in rheumatology.
Why is Your Language Model a Poor Implicit Reward Model?
Razin, Noam, Lin, Yong, Yao, Jiarui, Arora, Sanjeev
Reward models are key to language model post-training and inference pipelines. Conveniently, recent work showed that every language model defines an implicit reward model (IM-RM), without requiring any architectural changes. However, such IM-RMs tend to generalize worse, especially out-of-distribution, compared to explicit reward models (EX-RMs) that apply a dedicated linear head over the hidden representations of a language model. The existence of a generalization gap is puzzling, as EX-RMs and IM-RMs are nearly identical. They can be trained using the same data, loss function, and language model, and differ only in how the reward is computed. Towards a fundamental understanding of the implicit biases underlying different reward model types, we investigate the root cause of this gap. Our main finding, backed by theory and experiments, is that IM-RMs rely more heavily on superficial token-level cues. Consequently, they often generalize worse than EX-RMs under token-level distribution shifts, as well as in-distribution. Furthermore, we provide evidence against alternative hypotheses for the generalization gap. Most notably, we challenge the intuitive claim that IM-RMs struggle in tasks where generation is harder than verification because they can operate both as a verifier and a generator. Taken together, our results highlight that seemingly minor design choices can substantially impact the generalization behavior of reward models.
Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement
Guo, Haotan, He, Jianfei, Ma, Jiayuan, Na, Hongbin, Wang, Zimu, Zhang, Haiyang, Chen, Qi, Wang, Wei, Shi, Zijing, Shen, Tao, Chen, Ling
Phonetic Cloaking Replacement (PCR), defined as the deliberate use of homophonic or near-homophonic variants to hide toxic intent, has become a major obstacle to Chinese content moderation. While this problem is well-recognized, existing evaluations predominantly rely on rule-based, synthetic perturbations that ignore the creativity of real users. We organize PCR into a four-way surface-form taxonomy and compile \ours, a dataset of 500 naturally occurring, phonetically cloaked offensive posts gathered from the RedNote platform. Benchmarking state-of-the-art LLMs on this dataset exposes a serious weakness: the best model reaches only an F1-score of 0.672, and zero-shot chain-of-thought prompting pushes performance even lower. Guided by error analysis, we revisit a Pinyin-based prompting strategy that earlier studies judged ineffective and show that it recovers much of the lost accuracy. This study offers the first comprehensive taxonomy of Chinese PCR, a realistic benchmark that reveals current detectors' limits, and a lightweight mitigation technique that advances research on robust toxicity detection.
Robust Multimodal Large Language Models Against Modality Conflict
Zhang, Zongmeng, Zhou, Wengang, Zhao, Jie, Li, Houqiang
Despite the impressive capabilities of multimodal large language models (MLLMs) in vision-language tasks, they are prone to hallucinations in real-world scenarios. This paper investigates the hallucination phenomenon in MLLMs from the perspective of modality conflict. Unlike existing works focusing on the conflicts between model responses and inputs, we study the inherent conflicts in inputs from different modalities that place MLLMs in a dilemma and directly lead to hallucinations. We formally define the modality conflict and construct a dataset named Multimodal Modality Conflict (MMMC) to simulate this phenomenon in vision-language tasks. Three methods based on prompt engineering, supervised fine-tuning, and reinforcement learning are proposed to alleviate the hallucination caused by modality conflict. Extensive experiments are conducted on the MMMC dataset to analyze the merits and demerits of these methods. Our results show that the reinforcement learning method achieves the best performance in mitigating the hallucination under modality conflict, while the supervised fine-tuning method shows promising and stable performance. Our work sheds light on the unnoticed modality conflict that leads to hallucinations and provides more insights into the robustness of MLLMs.
CCQ: Convolutional Code for Extreme Low-bit Quantization in LLMs
Zhou, Zhaojing, Li, Xunchao, Li, Minghao, Zhang, Handi, Wang, Haoshuang, Chang, Wenbin, Liu, Yiqun, Dang, Qingqing, Yu, Dianhai, Ma, Yanjun, Wang, Haifeng
The rapid scaling of Large Language Models (LLMs) elevates inference costs and compounds substantial deployment barriers. While quantization to 8 or 4 bits mitigates this, sub-3-bit methods face severe accuracy, scalability, and efficiency degradation. We propose Convolutional Code Quantization (CCQ), an inference-optimized quantization approach compressing LLMs to 2.0-2.75 bits with minimal accuracy loss. Departing from error-prone scalar quantization or slow vector quantization, CCQ integrates a hardware-aware bit-shift encoding and decoding solution with Convolutional Code, Hybrid Encoding, and Code Cluster, jointly overcoming accuracy-speed bottlenecks. We construct a lookup-free encoding space, enabling a linear mapping between the codebook and weight vectors, thereby optimizing inference performance. Meanwhile, by drawing on the concept of data mapping from vector quantization, we minimize the performance degradation of the model under extremely low-bit conditions. Experiments demonstrate that CCQ achieves outstanding performance on LLMs across various benchmarks. We compress DeepSeek-V3 (671B total parameters) to 184GB and ERNIE-4.5-300B-A47B to 89GB, enabling single-GPU deployment of ERNIE 4.5 and eliminating inter-card communication. The 2-bit ERNIE-4.5-300B-A47B model and inference engine have been open-sourced.