Deep Learning
AI poses threat to journalism in Japan, news association chair says
The Asahi, along with the Nikkei and the Yomiuri Shimbun, filed a lawsuit with the Tokyo District Court against Perplexity in August. "Journalism should not tolerate freeloading," said Shiro Nakamura, who is also the chair of the Japan Newspaper Publishers & Editors Association (Nihon Shinbun Kyokai, or NSK), during a news conference at the Foreign Correspondents' Club of Japan on Friday. Nakamura said Japan's publishers across the board were concerned about the impact generative AI is having on the news business. In a time of both misinformation and too much information, quality journalism is more crucial than ever. By subscribing, you can help us get the story right. With your current subscription plan you can comment on stories.
Coevolving with the Other You: Fine-Tuning LLM with Sequential Cooperative Multi-Agent Reinforcement Learning Hao Ma
Reinforcement learning (RL) has emerged as a pivotal technique for fine-tuning large language models (LLMs) on specific tasks. However, prevailing RL fine-tuning methods predominantly rely on PPO and its variants. Though these algorithms are effective in general RL settings, they often exhibit suboptimal performance and vulnerability to distribution collapse when applied to the fine-tuning of LLMs.
Siegel Neural Networks
Nguyen, Xuan Son, Histace, Aymeric, Grozavu, Nistor
Riemannian symmetric spaces (RSS) such as hyperbolic spaces and symmetric positive definite (SPD) manifolds have become popular spaces for representation learning. In this paper, we propose a novel approach for building discriminative neural networks on Siegel spaces, a family of RSS that is largely unexplored in machine learning tasks. For classification applications, one focus of recent works is the construction of multiclass logistic regression (MLR) and fully-connected (FC) layers for hyperbolic and SPD neural networks. Here we show how to build such layers for Siegel neural networks. Our approach relies on the quotient structure of those spaces and the notation of vector-valued distance on RSS. We demonstrate the relevance of our approach on two applications, i.e., radar clutter classification and node classification. Our results successfully demonstrate state-of-the-art performance across all datasets.
Retrieval-Augmented Generation in Medicine: A Scoping Review of Technical Implementations, Clinical Applications, and Ethical Considerations
Yang, Rui, Wong, Matthew Yu Heng, Li, Huitao, Li, Xin, Zhu, Wentao, Liao, Jingchi, Yu, Kunyu, Liew, Jonathan Chong Kai, Xuan, Weihao, Chen, Yingjian, Ke, Yuhe, Ong, Jasmine Chiat Ling, Teodoro, Douglas, Hong, Chuan, Ting, Daniel Shi Wei, Liu, Nan
The rapid growth of medical knowledge and increasing complexity of clinical practice pose challenges. In this context, large language models ( LLMs) have demonstrated value; however, inherent limitations remain. Retrieval-augmented generation ( RAG) technologies show potential to enhance their clinical applicability. This study reviewed RAG applications in medicine. We found that research primarily relied on publicly available data, with limited application in private data. For retrieval, approaches commonly relied on English-centric embedding models, while LLMs were mostly generic, with limited use of medical-specific LLMs. For evaluation, automated metrics evaluated generation quality and task performance, whereas human evaluation focused on accuracy, completeness, relevance, and fluency, with insufficient attention to bias and safety. RAG applications were concentrated on question answering, report generation, text summarization, and information extraction. Overall, medical RAG remains at an early stage, requiring advances in clinical validation, cross-linguistic adaptation, and support for low-resource settings to enable trustworthy and responsible global use.
Order Matters: Rethinking Prompt Construction in In-Context Learning
Li, Warren, Wang, Yiqian, Wang, Zihan, Shang, Jingbo
In-context learning (ICL) enables large language models to perform new tasks by conditioning on a sequence of examples. Most prior work reasonably and intuitively assumes that which examples are chosen has a far greater effect on performance than how those examples are ordered, leading to a focus on example selection. We revisit this assumption and conduct a systematic comparison between the effect of selection and ordering. Through controlled experiments on both classification and generation tasks, using multiple open-source model families (0.5B to 27B parameters) and GPT-5, we find that the variance in performance due to different example orderings is comparable to that from using entirely different example sets. Furthermore, we show that strong orderings can be identified using only a development set, achieving performance close to an oracle that selects the best ordering based on test labels. Our findings highlight the equal and intertwined importance of example selection and ordering in prompt design, calling for a reexamination of the assumptions held in ICL.
AI-Integrated Decision Support System for Real-Time Market Growth Forecasting and Multi-Source Content Diffusion Analytics
Yin, Ziqing, Chen, Xuanjing, Zhang, Xi
The rapid proliferation of AI-generated content ( AIGC) has reshaped the dynamics of digital marketing and online consumer behavior. However, predicting the diffusion trajectory and market impact of such content remains challenging due to data heterogeneity, non-linear propagation mechanisms, and evolving consumer interactions. This study proposes an AI-driven Decision Support System ( DSS) that integrates multi-source data--including social media streams, marketing expenditure records, consumer engagement logs, and sentiment dynamics--using a hybrid Graph Neural Network ( GNN) and Temporal Transformer framework. The model jointly learns the content diffusion structure and temporal influence evolution through a dual-channel architecture, while causal inference modules disentangle the effects of marketing stimuli on return on investment ( ROI) and market visibility. Experiments on large-scale real-world datasets collected from multiple online platforms such as Twitter, Tik Tok, and You Tube advertising show that our system outperforms existing baselines in all six metrics. The proposed DSS enhances marketing decisions by providing interpretable real-time insights into AIGC driven content dissemination and market growth patterns.
Heuristic Transformer: Belief Augmented In-Context Reinforcement Learning
Dippel, Oliver, Lisitsa, Alexei, Peng, Bei
Transformers have demonstrated exceptional in-context learning (ICL) capabilities, enabling applications across natural language processing, computer vision, and sequential decision-making. In reinforcement learning, ICL reframes learning as a supervised problem, facilitating task adaptation without parameter updates. Building on prior work leveraging transformers for sequential decision-making, we propose Heuristic Transformer (HT), an in-context reinforcement learning (ICRL) approach that augments the in-context dataset with a belief distribution over rewards to achieve better decision-making. Using a variational auto-encoder (VAE), a low-dimensional stochastic variable is learned to represent the posterior distribution over rewards, which is incorporated alongside an in-context dataset and query states as prompt to the transformer policy. We assess the performance of HT across the Darkroom, Miniworld, and MuJoCo environments, showing that it consistently surpasses comparable baselines in terms of both effectiveness and generalization. Our method presents a promising direction to bridge the gap between belief-based augmentations and transformer-based decision-making.