Goto

Collaborating Authors

 user info


MetaAlign: Align Large Language Models with Diverse Preferences during Inference Time

arXiv.org Artificial Intelligence

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential. Existing alignment techniques, such as Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO), typically embed predefined preferences directly within the model's parameters. These methods, however, often result in a static alignment that can not account for the diversity of human preferences in practical applications. In response to this challenge, we propose an effective method, \textbf{MetaAlign}, which aims to help LLMs dynamically align with various explicit or implicit preferences specified at inference time. Experimental results show that LLMs optimized on our meticulously constructed MetaAlign Dataset can effectively align with any preferences specified at the inference stage, validating the feasibility of MetaAlign. We hope that our work can provide some insights into the alignment of language models.


User Information Augmented Semantic Frame Parsing using Coarse-to-Fine Neural Networks

arXiv.org Artificial Intelligence

Semantic frame parsing is a crucial component in spoken language understanding (SLU) to build spoken dialog systems. It has two main tasks: intent detection and slot filling. Although state-of-the-art approaches showed good results, they require large annotated training data and long training time. In this paper, we aim to alleviate these drawbacks for semantic frame parsing by utilizing the ubiquitous user information. We design a novel coarse-to-fine deep neural network model to incorporate prior knowledge of user information intermediately to better and quickly train a semantic frame parser. Due to the lack of benchmark dataset with real user information, we synthesize the simplest type of user information (location and time) on ATIS benchmark data. The results show that our approach leverages such simple user information to outperform state-of-the-art approaches by 0.25% for intent detection and 0.31% for slot filling using standard training data. When using smaller training data, the performance improvement on intent detection and slot filling reaches up to 1.35% and 1.20% respectively. We also show that our approach can achieve similar performance as state-of-the-art approaches by using less than 80% annotated training data. Moreover, the training time to achieve the similar performance is also reduced by over 60%.


Facebook Data Collection: Germany Investigates Social Network 'Extorting' User Info

International Business Times

Germany may soon launch an investigation into Facebook over the social network's broad privacy policy that allows it to collect massive amounts of information from users. They, in part, blame the "fine print" of Facebook's terms of service. The Federal Cartel Office, Germany's national competition regulator, believes Facebook is "extorting" its users by making them agree to terms and conditions they may not fully understand in order to use the popular service. German regulators have also floated the possibility that anti-trust actions could use this angle in the courts. Read: Why Was Google Fined $2.7 Billion By The European Union?