Constraint-Based Reasoning
Learning Constraints From Examples
Raedt, Luc De (KU Leuven) | Passerini, Andrea (University of Trento) | Teso, Stefano (KU Leuven)
While constraints are ubiquitous in artificial intelligence and constraints are also commonly used in machine learning and data mining, the problem of learning constraints from examples has received less attention. In this paper, we discuss the problem of constraint learning in detail, indicate some subtle differences with standard machine learning problems, sketch some applications and summarize the state-of-the-art.
Multiagent Simple Temporal Problem: The Arc-Consistency Approach
Kong, Shufeng (University of Technology Sydney) | Lee, Jae Hee (University of Technology Sydney) | Li, Sanjiang (University of Technology Sydney)
The Simple Temporal Problem (STP) is a fundamental temporal reasoning problem and has recently been extended to the Multiagent Simple Temporal Problem (MaSTP). In this paper we present a novel approach that is based on enforcing arc-consistency (AC) on the input (multiagent) simple temporal network. We show that the AC-based approach is sufficient for solving both the STP and MaSTP and provide efficient algorithms for them. As our AC-based approach does not impose new constraints between agents, it does not violate the privacy of the agents and is superior to the state-of-the-art approach to MaSTP. Empirical evaluations on diverse benchmark datasets also show that our AC-based algorithms for STP and MaSTP are significantly more efficient than existing approaches.
A Recursive Scenario Decomposition Algorithm for Combinatorial Multistage Stochastic Optimisation Problems
Hemmi, David (Monash University) | Tack, Guido (Data61) | Wallace, Mark (Monash University)
Stochastic programming is concerned with decision making under uncertainty, seeking an optimal policy with respect to a set of possible future scenarios. This paper looks at multistage decision problems where the uncertainty is revealed over time. First, decisions are made with respect to all possible future scenarios. Secondly, after observing the random variables, a set of scenario specific decisions is taken. Our goal is to develop algorithms that can be used as a back-end solver for high-level modeling languages. In this paper we propose a scenario decomposition method to solve multistage stochastic combinatorial decision problems recursively. Our approach is applicable to general problem structures, utilizes standard solving technology and is highly parallelizable. We provide experimental results to show how it efficiently solves benchmarks with hundreds of scenarios.
Decision Making Over Combinatorially-Structured Domains
Martin, Andrea (Tulane University) | Venable, K. Brent (Tulane University)
We consider a scenario where a user must make a set of correlated decisions and we propose a computational modeling of the deliberation process. We assume the user compactly expresses her preferences via soft constraints. We consider a sequential procedure that uses Decision Field Theory to model the decision making on each variable. We test this procedure on randomly generated tree-shaped Fuzzy Constraint Satisfaction Problems. Our preliminary results showed that the time increases almost in the number of nodes. This is promising in terms of modeling decision over exponentially large domains. In the future, we plan to compare our results non-sequential approach and with behavioral data to asses our approach both in terms of modeling human decision making over complex domains, and adopting DFT as a means of incorporating a form of uncertainty into the soft constraint formalism.
Constraint Satisfaction Techniques for Combinatorial Problems
Narváez, David E. (Rochester Institute of Technology)
In recent years, constraint satisfaction problems (CSPs) have drawn much attention due to their applications to several areas In its more general form, constraint satisfaction problems of industrial research. This research focus has brought (CSPs) consist of a set of variables X each taking values in a torrent of positive results in areas like SAT solvers, satisfiability a domain D and a set of constraints C involving variables modulo theories, answer set programming, etc. in X and operations over these variables. For instance, in These results often rely on the fact that even though determining Boolean satisfiability problems the domain D takes the form the satisfiability of a constraint program is NPhard, of {, } and the constraints are expressed over the operations many industrial applications exhibit constraints that computers,, . In the case of integer linear programs (ILP), are able to deal with easily. Benchmarks stemming from the domain of the variables is the set of integers, and the these applications often showcase the advantages of the different constraints are inequalities over the operations of addition techniques presented, and seldom are there references and multiplication.
Decomposition-Based Solving Approaches for Stochastic Constraint Optimisation
Hemmi, David (Monash University)
Combinatorial optimisation problems often contain uncertainty that has to be taken into account to produce realistic solutions. A common way to describe the uncertainty is by means of scenarios, where each scenario describes different potential sets of problem parameters based on random distributions or historical data. While efficient algorithmic techniques exist for specific problem classes such as linear programs, there are very few approaches that can handle general Constraint Programming formulations subject to uncertainty. The goal of my PhD is to develop generic methods for solving stochastic combinatorial optimisation problems formulated in a Constraint Programming framework.
Enhancing Constraint-Based Multi-Objective Combinatorial Optimization
Terra-Neves, Miguel (INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal) | Lynce, Inês (INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal) | Manquinho, Vasco (INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal)
Minimal Correction Subsets (MCSs) have been successfully applied to find approximate solutions to several real-world single-objective optimization problems. However, only recently have MCSs been used to solve Multi-Objective Combinatorial Optimization (MOCO) problems. In particular, it has been shown that all optimal solutions of MOCO problems with linear objective functions can be found by an MCS enumeration procedure. In this paper, we show that the approach of MCS enumeration can also be applied to MOCO problems where objective functions are divisions of linear expressions. Hence, it is not necessary to use a linear approximation of these objective functions. Additionally, we also propose the integration of diversification techniques on the MCS enumeration process in order to find better approximations of the Pareto front of MOCO problems. Finally, experimental results on the Virtual Machine Consolidation (VMC) problem show the effectiveness of the proposed techniques.
Premise Set Caching for Enumerating Minimal Correction Subsets
Previti, Alessandro (University of Helsinki) | Mencía, Carlos (University of Oviedo) | Järvisalo, Matti (University of Helsinki) | Marques-Silva, Joao (University of Lisbon)
Methods for explaining the sources of inconsistency of overconstrained systems find an ever-increasing number of applications, ranging from diagnosis and configuration to ontology debugging and axiom pinpointing in description logics. Efficient enumeration of minimal correction subsets (MCSes), defined as sets of constraints whose removal from the system restores feasibility, is a central task in such domains. In this work, we propose a novel approach to speeding up MCS enumeration over conjunctive normal form propositional formulas by caching of so-called premise sets (PSes) seen during the enumeration process. Contrasting to earlier work, we move from caching unsatisfiable cores to caching PSes and propose a more effective way of implementing the cache. The proposed techniques noticeably improves on the performance of state-of-the-art MCS enumeration algorithms in practice.
Parallel Algorithms for Operations on Multi-Valued Decision Diagrams
Perez, Guillaume (Cornell University) | Régin, Jean-Charles (University of Nice-Sophia Antipolis)
Multi-valued Decision Diagrams (MDDs) have been extensively studied in the last ten years. Recently, efficient algorithms implementing operators such as reduction, union, intersection, difference, etc., have been designed. They directly deal with the graph structure of the MDD and a time reduction of several orders of magnitude in comparison to other existing algorithms have been observed. These operators have permitted a new look at MDDs, because extremely large MDDs can finally be manipulated as shown by the models used to solve complex application in music generation. However, MDDs become so large (50GB) that minutes are sometimes required to perform some operations. In order to accelerate the manipulation of MDDs, parallel algorithms are required. In this paper, we introduce such algorithms. We carefully design them in order to overcome inherent difficulties of the parallelization of sequential algorithms such as data dependencies, software lock-out, false sharing, or load balancing. As a result, we observe a speed-up , i.e. ratio between parallel and sequential runtimes, growing linearly with the number of cores.
Exact MAP-Inference by Confining Combinatorial Search With LP Relaxation
Haller, Stefan (University of Heidelberg) | Swoboda, Paul (IST Austria) | Savchynskyy, Bogdan (University of Heidelberg)
We consider the MAP-inference problem for graphical models, which is a valued constraint satisfaction problem defined on real numbers with a natural summation operation. We propose a family of relaxations (different from the famous Sherali-Adams hierarchy), which naturally define lower bounds for its optimum. This family always contains a tight relaxation and we give an algorithm able to find it and therefore, solve the initial non-relaxed NP-hard problem. The relaxations we consider decompose the original problem into two non-overlapping parts: an easy LP-tight part and a difficult one. For the latter part a combinatorial solver must be used. As we show in our experiments, in a number of applications the second, difficult part constitutes only a small fraction of the whole problem. This property allows to significantly reduce the computational time of the combinatorial solver and therefore solve problems which were out of reach before.