Problem Solving
Steps Towards a Science of Heuristic Search
Wilt, Christopher Makoto (University of New Hampshire)
There are many algorithms designed to solve the shortest path problem. Each of the published algorithms has a demonstrated use; a situation in which it is the clear choice.ย Unfortunately, if faced with a novel problem, there is no reliable robust way to figure out which algorithm should be used to solve the new problem. When classifying things, the first step is to identify relevant features for classifications.ย In the context of heuristic search, it not clear what pieces of information should be used to predict search algorithm performance, and the question of algorithm selection for a novel domain is an open question. We first analyze which domain attributes common algorithms leverage, and discuss how to identify domains containing these attributes.ย In addition to discussing how to classify domains, we also discuss why the classifications matter for various algorithms.ย Ultimately, this will allow us to offer more accurate runtime predictions for various algorithms we analyze, allowing us to determine which algorithm will likely offer the best performance.
Concurrent Inference Graphs
Schlegel, Daniel R. (University at Buffalo)
Since their popularity began to rise in the mid-2000s there has been significant growth in the number of multi-core and multi-processor computers available. Knowledge representation systems using logical inference have been slow to embrace this new technology. We present the concept of inference graphs, a natural deduction inference system which scales well on multi-core and multi-processor machines. Inference graphs enhance propositional graphs by treating propositional nodes as tasks which can be scheduled to operate upon messages sent between nodes via the arcs that already exist as part of the propositional graph representation. The use of scheduling heuristics within a prioritized message passing architecture allows inference graphs to perform very well in forward, backward, bi-directional, and focused reasoning. Tests demonstrate the usefulness of our scheduling heuristics, and show significant speedup in both best case and worst case inference scenarios as the number of processors increases.
Partial Domain Search Tree For Constraint-Satisfaction Problems
Sharon, Guni (Ben-Gurion University) | Felner, Ariel (Ben-Gurion University) | Stern, Roni (Ben-Gurion University) | Sturtevant, Nathan (University of Denver)
CSP solvers usually search a partial assignment search tree.We present a new formalization for CSP solvers, which spansa conceptually different search tree, where each node representssubsets of the original domains for the variables. We experimentwith a simple backtracking algorithm for this searchtree and show that it outperforms a simple backtracking algorithmon the traditional search tree in many cases.
Symbol Acquisition for Task-Level Planning
Konidaris, George (Massachusetts Institute of Technology) | Kaelbling, Leslie Pack (Massachusetts Institute of Technology) | Lozano-Perez, Tomas (Massachusetts Institute of Technology)
We consider the problem of how to plan efficiently in low-level, continuous state spaces with temporally abstract actions (or skills), by constructing abstract representations of the problem suitable for task-level planning.The central question this effort poses is which abstract representations are required to express and evaluate plans composed of sequences of skills. We show that classifiers can be used as a symbolic representation system, and that the ability to represent the preconditions and effects of an agent's skills is both necessary and sufficient for task-level planning.The resulting representations allow a reinforcement learning agent to acquire a symbolic representation appropriate for planning from experience.
Learning about Representational Modality: Design and Programming Projects for Knowledge-Based AI
Goel, Ashok K. (Georgia Institute of Technology) | Kunda, Maithilee (Georgia Institute of Technology) | Joyner, David (Georgia Institute of Technology) | Vattam, Swaroop (Georgia Institute of Technology)
Many AI courses include design and programming projects that provide students with opportunities for experiential learning. Design and programming projects in courses on knowledge-based AI typically explore topics in knowledge, memory, reasoning, and learning. Traditional AI curricula, however, seldom highlight issues of modality of representations, often focusing solely on propositional representations. In this paper, we report on an investigation into learning about representational modality through a series of projects based around geometric analogy problems similar to the Ravenโs Progressive Matrices test of intelligence. We conducted this experiment over three years, from Fall 2010 through Fall 2012, in a class on knowledge-based AI. We used the methodology of action research in which the teacher is also the researcher. We discovered that students found these projects motivating, engaging, and challenging, in several cases investing significant time and posting their work online. From our perspective, the projects accomplished the goal of learning about representational modality in addition to knowledge representation and reasoning.
Concurrent Reasoning with Inference Graphs
Schlegel, Daniel R. (University at Buffalo) | Shapiro, Stuart C. (University at Buffalo)
Since their popularity began to rise in the mid-2000s there has been significant growth in the number of multi-core and multi-processor computers available. Knowledge representation systems using logical inference have been slow to embrace this new technology. We present the concept of inference graphs, a natural deduction inference system which scales well on multi-core and multi-processor machines. Inference graphs enhance propositional graphs by treating propositional nodes as tasks which can be scheduled to operate upon messages sent between nodes via the arcs that already exist as part of the propositional graph representation. The use of scheduling heuristics within a prioritized message passing architecture allows inference graphs to perform very well in forward, backward, bi-directional, and focused reasoning. Tests demonstrate the usefulness of our scheduling heuristics, and show significant speedup in both best case and worst case inference scenarios as the number of processors increases.
Hypothesis Exploration for Malware Detection Using Planning
Sohrabi, Shirin (IBM T. J. Watson Research Center) | Udrea, Octavian (IBM T. J. Watson Research Center) | Riabov, Anton (IBM T. J. Watson Research Center)
In this paper we apply AI planning to address the hypothesis exploration problem and provide assistance to network administrators in detecting malware based on unreliable observations derived from network traffic.Building on the already established characterization and use of AI planning for similar problems, we propose a formulation of the hypothesis generation problem for malware detection as an AI planning problem with temporally extended goals and actions costs. Furthermore, we propose a notion of hypothesis ``plausibility'' under unreliable observations, which we model as plan quality. We then show that in the presence of unreliable observations, simply finding one most ``plausible'' hypothesis, although challenging, is not sufficient for effective malware detection. To that end, we propose a method for applying a state-of-the-art planner within a principled exploration process, to generate multiple distinct high-quality plans. We experimentally evaluate this approach by generating random problems of varying hardness both with respect to the number of observations, as well as the degree of unreliability. Based on these experiments, we argue that our approach presents a significant improvement over prior work that are focused on finding a single optimal plan, and that our hypothesis exploration application can motivate the development of new planners capable of generating the top high-quality plans.
A First-Order Formalization of Commitments and Goals for Planning
Meneguzzi, Felipe (Pontifical Catholic University of Rio Grande do Sul) | Telang, Pankaj R. (North Carolina State University) | Singh, Munindar P. (North Carolina State University)
Commitments help model interactions in multiagent systems in a computationally realizable yet high-level manner without compromising the autonomy and heterogeneity of the member agents. Recent work shows how to combine commitments with goals and apply planning methods to enable agents to determine their actions. However, previous approaches to modeling commitments are confined to propositional representations, which limits their applicability in practical cases. We propose a first-order representation and reasoning technique that accommodates templatic commitments and goals that may be applied repeatedly with differing bindings for domain objects. Doing so not only leads to a more perspicuous modeling, but also supports many practical patterns.
Reciprocal Hash Tables for Nearest Neighbor Search
Liu, Xianglong (Beihang University) | He, Junfeng (Columbia University andย Facebook) | Lang, Bo (Beihang University)
Recent years have witnessed the success of hashingtechniques in approximate nearest neighbor search. Inpractice, multiple hash tables are usually employed toretrieve more desired results from all hit buckets ofeach table. However, there are rare works studying theunified approach to constructing multiple informativehash tables except the widely used random way. In thispaper, we regard the table construction as a selectionproblem over a set of candidate hash functions. Withthe graph representation of the function set, we proposean efficient solution that sequentially applies normal-ized dominant set to finding the most informative andindependent hash functions for each table. To furtherreduce the redundancy between tables, we explore thereciprocal hash tables in a boosting manner, where thehash function graph is updated with high weights em-phasized on the misclassified neighbor pairs of previoushash tables. The construction method is general andcompatible with different types of hashing algorithmsusing different feature spaces and/or parameter settings.Extensive experiments on two large-scale benchmarksdemonstrate that the proposed method outperforms bothnaive construction method and state-of-the-art hashingalgorithms, with up to 65.93% accuracy gains.
Story Generation with Crowdsourced Plot Graphs
Li, Boyang (Georgia Institute of Technology) | Lee-Urban, Stephen (Georgia Institute of Technology) | Johnston, George (Georgia Institute of Technology) | Riedl, Mark (Georgia Institute of Technology)
Story generation is the problem of automatically selecting a sequence of events that meet a set of criteria and can be told as a story. Story generation is knowledge-intensive; traditional story generators rely on a priori defined domain models about fictional worlds, including characters, places, and actions that can be performed. Manually authoring the domain models is costly and thus not scalable. We present a novel class of story generation system that can generate stories in an unknown domain. Our system (a) automatically learns a domain model by crowdsourcing a corpus of narrative examples and (b) generates stories by sampling from the space defined by the domain model. A large-scale evaluation shows that stories generated by our system for a previously unknown topic are comparable in quality to simple stories authored by untrained humans