Search
Just Count the Satisfied Groundings: Scalable Local-Search and Sampling Based Inference in MLNs
Venugopal, Deepak (The University of Texas at Dallas) | Sarkhel, Somdeb (The University of Texas at Dallas) | Gogate, Vibhav (The University of Texas at Dallas)
The main computational bottleneck in various sampling based and local-search based inference algorithms for Markov logic networks (e.g., Gibbs sampling, MC-SAT, MaxWalksat, etc.) is computing the number of groundings of a first-order formula that are true given a truth assignment to all of its ground atoms. We reduce this problem to the problem of counting the number of solutions of a constraint satisfaction problem (CSP) and show that during their execution, both sampling based and local-search based algorithms repeatedly solve dynamic versions of this counting problem. Deriving from the vast amount of literature on CSPs and graphical models, we propose an exact junction-tree based algorithm for computing the number of solutions of the dynamic CSP, analyze its properties, and show how it can be used to improve the computational complexity of Gibbs sampling and MaxWalksat. Empirical tests on a variety of benchmarks clearly show that our new approach is several orders of magnitude more scalable than existing approaches.
On Interruptible Pure Exploration in Multi-Armed Bandits
Shleyfman, Alexander (Technion – Israel Institute of Technology) | Komenda, Antonín (Czech Technical University in Prague) | Domshlak, Carmel (Technion – Israel Institute of Technology)
Interruptible pure exploration in multi-armed bandits (MABs) is a key component of Monte-Carlo tree search algorithms for sequential decision problems. We introduce Discriminative Bucketing (DB), a novel family of strategies for pure exploration in MABs, which allows for adapting recent advances in non-interruptible strategies to the interruptible setting, while guaranteeing exponential-rate performance improvement over time. Our experimental evaluation demonstrates that the corresponding instances of DB favorably compete both with the currently popular strategies UCB1 and Epsilon-Greedy, as well as with the conservative uniform sampling.
Automatic Configuration of Sequential Planning Portfolios
Seipp, Jendrik (University of Basel) | Sievers, Silvan (University of Basel) | Helmert, Malte (University of Basel) | Hutter, Frank (University of Freiburg)
Sequential planning portfolios exploit the complementary strengths of different planners. Similarly, automated algorithm configuration tools can customize parameterized planning algorithms for a given type of tasks. Although some work has been done towards combining portfolios and algorithm configuration, the problem of automatically generating a sequential planning portfolio from a parameterized planner for a given type of tasks is still largely unsolved. Here, we present Cedalion, a conceptually simple approach for this problem that greedily searches for the pair of parameter configuration and runtime which, when appended to the current portfolio, maximizes portfolio improvement per additional runtime spent. We show theoretically that Cedalion yields portfolios provably within a constant factor of optimal for the training set distribution. We evaluate Cedalion empirically by applying it to construct sequential planning portfolios based on component planners from the highly parameterized Fast Downward (FD) framework. Results for a broad range of planning settings demonstrate that -- without any knowledge of planning or FD -- Cedalion constructs sequential FD portfolios that rival, and in some cases substantially outperform, manually-built FD portfolios.
Heuristics and Symmetries in Classical Planning
Shleyfman, Alexander (Technion – Israel Institute of Technology) | Katz, Michael (IBM Haifa Research Lab) | Helmert, Malte (University of Basel) | Sievers, Silvan (University of Basel) | Wehrle, Martin (University of Basel)
Heuristic search is a state-of-the-art approach to classical planning. Several heuristic families were developed over the years to automatically estimate goal distance information from problem descriptions. Orthogonally to the development of better heuristics, recent years have seen an increasing interest in symmetry-based state space pruning techniques that aim at reducing the search effort. However, little work has dealt with how the heuristics behave under symmetries. We investigate the symmetry properties of existing heuristics and reveal that many of them are invariant under symmetries.
An Exact Algorithm for Solving Most Relevant Explanation in Bayesian Networks
Zhu, Xiaoyuan (Queens College, City University of New York) | Yuan, Changhe (Queens College, City University of New York)
Most Relevant Explanation (MRE) is a new inference task in Bayesian networks that finds the most relevant partial instantiation of target variables as an explanation for given evidence by maximizing the Generalized Bayes Factor (GBF). No exact algorithm has been developed for solving MRE previously. This paper fills the void and introduces a breadth-first branch-and-bound MRE algorithm based on a novel upper bound on GBF. The bound is calculated by decomposing the computation of the score to a set of Markov blankets of subsets of evidence variables. Our empirical evaluations show that the proposed algorithm scales up exact MRE inference significantly.
Lifting Model Sampling for General Game Playing to Incomplete-Information Models
Schofield, Michael (University of New South Wales) | Thielscher, Michael (University of New South Wales)
General Game Playing is the design of AI systems able to understand the rules of new games and to use such descriptions to play those games effectively. Games with incomplete information have recently been added as anew challenge for general game-playing systems. The only published solutions to this challenge are based on sampling complete information models. In doing so they ground all of the unknown information, thereby making information gathering moves of no value; a well-known criticism of such sampling based systems. We present and analyse a method for escalating reasoning from complete information models to incomplete information models and show how this enables a general game player to correctly value information in incomplete information games. Experimental results demonstrate the success of this technique over standard model sampling.
Interactive Narrative Planning in The Best Laid Plans
Ware, Stephen G. (University of New Orleans) | Young, R. Michael (North Carolina State University) | Stith, Christian (Clemson University) | Wright, Phillip (North Carolina State University)
The Best Laid Plans is an interactive narrative video game that uses cognitive-inspired fast planning techniques to generate stories with conflict during play. Players alternate between acting out a plan and seeing that plan thwarted by non-player characters. The Glaive narrative planner combines causal-link-based computational models of narrative with the speed of fast heuristic search techniques to adapt the story each time the player attempts a new plan.
An Efficient Forest-Based Tabu Search Algorithm for the Split-delivery Vehicle Routing Problem
Zhang, Zizhen (Sun Yat-Sen University) | He, Huang (Sun Yat-Sen University) | Luo, Zhixing (City University of Hong Kong) | Qin, Hu (Huazhong University of Science and Technology) | Guo, Songshan (Sun Yat-Sen University)
The defining characteristic the SDVRP, where vehicle capacity and customer demands of the SDVRP that distinguishes it from the classical are not required to be integer numbers, the number of vehicles vehicle routing problem (VRP) is that each customer is not limited to the minimum possible number, and can be served by more than one vehicle. Obviously, when the customer demands may exceed the vehicle capacity. The the demand of a customer is lager than the vehicle capacity, main contributions are threefold. First, we find a novel way it has to be split and the customer has to be visited more to represent the solutions of the SDVRP, which is the combination than once. As shown by (Dror and Trudeau 1989), when all of a set of vehicle routes and a forest. Second, based customer demands are less than or equal to the vehicle capacity, on this solution representation, we propose three classes of split delivery can also lead to substantial cost savings.
Planning with Numeric Timed Initial Fluents
Piacentini, Chiara (King's College London) | Fox, Maria (King's College London) | Long, Derek (King's College London)
Numeric Timed Initial Fluents represent a new feature in PDDL that extends the concept of Timed Initial Literals to numeric fluents. They are particularly useful to model independent functions that change through time and influence the actions to be applied. Although they are very useful to model real world problems, they are not systematically defined in the family of PDDL languages and they are not implemented in any generic PDDL planner, except for POPF2 and UPMurphi. In this paper we present an extension of the planner POPF2 (POPF-TIF) to handle problems with numeric Timed Initial Fluents. We propose and evaluate two contributions: the first is based on improvements of the heuristic evaluation, while the second considers alternative search algorithms based on a mixture of Enforced Hill Climbing and Best First Search.
From Non-Negative to General Operator Cost Partitioning
Pommerening, Florian (University of Basel) | Helmert, Malte (University of Basel) | Röger, Gabriele (University of Basel) | Seipp, Jendrik (University of Basel)
Operator cost partitioning is a well-known technique to make admissible heuristics additive by distributing the operator costs among individual heuristics. Planning tasks are usually defined with non-negative operator costs and therefore it appears natural to demand the same for the distributed costs. We argue that this requirement is not necessary and demonstrate the benefit of using general cost partitioning. We show that LP heuristics for operator-counting constraints are cost-partitioned heuristics and that the state equation heuristic computes a cost partitioning over atomic projections. We also introduce a new family of potential heuristics and show their relationship to general cost partitioning.