Goto

Collaborating Authors

 rab


Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Qi, Yunjia, Peng, Hao, Wang, Xiaozhi, Xu, Bin, Hou, Lei, Li, Juanzi

arXiv.org Artificial Intelligence

Large language models (LLMs) struggle to follow instructions with complex constraints in format, length, etc. Following the conventional instruction-tuning practice, previous works conduct post-training on complex instruction-response pairs generated by feeding complex instructions to advanced LLMs. However, even advanced LLMs cannot follow complex instructions well, thus limiting the quality of generated data. In this work, we find that existing datasets inherently contain implicit complex constraints and propose a novel data generation technique, constraint back-translation. Specifically, we take the high-quality instruction-response pairs in existing datasets and only adopt advanced LLMs to add complex constraints already met by the responses to the instructions, which naturally reduces costs and data noise. In the experiments, we adopt Llama3-70B-Instruct to back-translate constraints and create a high-quality complex instruction-response dataset, named CRAB. We present that post-training on CRAB improves multiple backbone LLMs' complex instruction-following ability, evaluated on extensive instruction-following benchmarks. We further find that constraint back-translation also serves as a useful auxiliary training objective in post-training. Our code, data, and models will be released to facilitate future research.


Relational Action Bases: Formalization, Effective Safety Verification, and Invariants (Extended Version)

Ghilardi, Silvio, Gianola, Alessandro, Montali, Marco, Rivkin, Andrey

arXiv.org Artificial Intelligence

Modeling and verification of dynamic systems operating over a relational representation of states are increasingly investigated problems in AI, Business Process Management, and Database Theory. To make these systems amenable to verification, the amount of information stored in each relational state needs to be bounded, or restrictions are imposed on the preconditions and effects of actions. We introduce the general framework of relational action bases (RABs), which generalizes existing models by lifting both these restrictions: unbounded relational states can be evolved through actions that can quantify both existentially and universally over the data, and that can exploit numerical datatypes with arithmetic predicates. We then study parameterized safety of RABs via (approximated) SMT-based backward search, singling out essential meta-properties of the resulting procedure, and showing how it can be realized by an off-the-shelf combination of existing verification modules of the state-of-the-art MCMT model checker. We demonstrate the effectiveness of this approach on a benchmark of data-aware business processes. Finally, we show how universal invariants can be exploited to make this procedure fully correct.


Senior Data Scientist - @adam_rab (Python, SAS, Hadoop, R, Matlab, Machine learning, natural language processing, CPlex, C , etc.)

#artificialintelligence

By providing us with your information, you agree to become a Bullhorn Reach User, and to our use and disclosure of your information as described by our Privacy Policy. My clients are looking for computer scientists, statisticians, biostatisticians, physicists, computational social scientists, economists, engineers, operations researchers- in short they are looking for Data Scientist with strong hands on experience in "Big Data" as well as predictive modeling, optimization, machine learning, neural networks using a range of advanced technical tools (Python, SAS, Hadoop, R, Matlab, Machine learning, natural language processing, CPlex, C, etc.) This is a position that will be responsible for helping develop quantitative solutions to solve complex applications. The candidates will be involved in developing leading-edge, "out of the box" advanced analytic solutions and processes.


APPEARED IN ACM-SIGMOD 1979, HPP-79-27

AI Classics

For example, a for an integrated database requires each pctential relation in a user view may be a'JOIN' of two user or application to specify its view as a data


Fast Heuristic Search for RTS Game Combat Scenarios

Churchill, David (University of Alberta) | Saffidine, Abdallah (Université Paris-Dauphine) | Buro, Michael (University of Alberta)

AAAI Conferences

Heuristic search has been very successful in abstract game domains such as Chess and Go. In video games, however, adoption has been slow due to the fact that state and move spaces are much larger, real-time constraints are harsher, and constraints on computational resources are tighter. In this paper we present a fast search method — Alpha-Beta search for durative moves— that can defeat commonly used AI scripts in RTS game combat scenarios of up to 8 vs. 8 units running on a single core in under 5ms per search episode. This performance is achieved by using standard search enhancements such as transposition tables and iterative deepening, and novel usage of combat AI scripts for sorting moves and state evaluation via playouts. We also present evidence that commonly used combat scripts are highly exploitable — opening the door for a promising line of research on opponent combat modelling.