We consider how to learn Hierarchical Task Networks (HTNs) for planning problems in which both the quality of solution plans generated by the HTNs and the speed at which those plans are found is important. We describe an integration of HTN Learning with Reinforcement Learning to both learn methods by analyzing semantic annotations on tasks and to produce estimates of the expected values of the learned methods by performing Monte Carlo updates. We performed an experiment in which plan quality was inversely related to plan length. In two planning domains, we evaluated the planning performance of the learned methods in comparison to two state-of-the-art satisficing classical planners, FastForward and SGPlan6, and one optimal planner, HSP*. The results demonstrate that a greedy HTN planner using the learned methods was able to generate higher quality solutions than SGPlan6 in both domains and FastForward in one. Our planner, FastForward, and SGPlan6 ran in similar time, while HSP* was exponentially slower.

These formalisms have in common the use of certain kinds of constructs (for example, objects, goals, skills, and tasks) that represent knowledge of varying degrees of complexity and that are connected through structural relations. In recent years, we have observed increasing interest toward the problem of learning such structural knowledge from observations. These observations range from traces generated by an automated planner to video feeds from a robot performing some actions. The goal of the workshop was to bring researchers together from machine learning, automated planning, case-based reasoning, cognitive science, and other communities that are looking into instances of this problem and to share ideas and perspectives in a common forum.

Dynamic scripting is a reinforcement learning approach to adaptive game AI that learns, during gameplay, which game tactics an opponent should select to play effectively. We introduce the evolutionary state-based tactics generator (ESTG), which uses an evolutionary algorithm to generate tactics automatically. Experimental results show that ESTG improves dynamic scripting's performance in a real-time strategy game. We conclude that high-quality domain knowledge can be automatically generated for strong adaptive game AI opponents.

The decision-making process of computer-controlled opponents in video games is called game AI. Adaptive game AI can improve the entertainment value of games by allowing computer-controlled opponents to ix weaknesses automatically in the game AI and to respond to changes in human-player tactics. Dynamic scripting is a reinforcement learning approach to adaptive game AI that learns, during gameplay, which game tactics an opponent should select to play effectively. In previous work, the tactics used by dynamic scripting were designed manually. We introduce the evolutionary state-based tactics generator (ESTG), which uses an evolutionary algorithm to generate tactics automatically. Experimental results show that ESTG improves dynamic scripting's performance in a real-time strategy game. We conclude that high-quality domain knowledge can be automatically generated for strong adaptive game AI opponents. Game developers can bene it from applying ESTG, as it considerably reduces the time and effort needed to create adaptive game AI.

The Sixth International Conference on Case-Based Reasoning (ICCBR-05) took place from 23 August through 26 August 2005 at the downtown campus of De- Paul University, in the heart of Chicago's downtown Loop. The conference program included Industry Day, four workshops, and two days of technical paper presentations divided into poster sessions and a single plenary track. This report describes the conference in detail.

The program committee selected the paper "Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game" by David W. Aha (Naval Research Laboratory), The second day featured reasoning research. This report describes the conference in detail. David Aha noted the need Derek Bridge, the University College to enhance the theoretical foundations Case-Based Reasoning (ICCBR) Cork, and Craig Knoblock, the of CBR. College Dublin) stressed the fact that meeting on case-based reasoning ICCBR-05 received 74 paper submissions in recent years we have focused on (CBR). Of these, the program committee needed with respect to experience highlighting the most significant selected 26 for poster presentations modeling and reuse.

This article presents an overview and survey of current work in case-based reasoning (CBR) integrations. There has been a recent upsurge in the integration of CBR with other reasoning modalities and computing paradigms, especially rule-based reasoning (RBR) and constraint-satisfaction problem (CSP) solving. CBR integrations with modelbased reasoning (MBR), genetic algorithms, and information retrieval are also discussed. This article characterizes the types of multimodal reasoning integrations where CBR can play a role, identifies the types of roles that CBR components can fulfill, and provides examples of integrated CBR systems.

This article presents an overview and survey of current work in case-based reasoning (CBR) integrations. There has been a recent upsurge in the integration of CBR with other reasoning modalities and computing paradigms, especially rule-based reasoning (RBR) and constraint-satisfaction problem (CSP) solving. CBR integrations with modelbased reasoning (MBR), genetic algorithms, and information retrieval are also discussed. This article characterizes the types of multimodal reasoning integrations where CBR can play a role, identifies the types of roles that CBR components can fulfill, and provides examples of integrated CBR systems. Past progress, current trends, and issues for future research are discussed.

Shop is a hierarchical task network planning algorithm that is provably sound and complete across a large class of planning domains. It plans for tasks in the same order that they will later be executed, and thus, it knows the current world state at each step of the planning process. For example, shop's preconditions can include logical inferences, complex numeric computations, and calls to external programs.

For more details, see Nau et al. 's preconditions can include logical inferences, 's preconditions two methods for traveling from one location can include Horn-clause inferencing, numeric to another: (1) traveling by airplane and (2) computations, and calls to external programs. 's expressive power can be used to create a totally ordered list of subtasks. Suppose domain representations for complex application that all these subtasks are primitive except for domains. For example, the Horn 4. if t is primitive (i.e., there is an operator for t) then clauses can include calls to attached procedures 5. nondeterministically choose an operator o for t We believe the primary 14. endif's higher level of expressivity made it possible to formulate highly expressive domain algorithms in's data structures to make them faster; for example, we found that a simple change to the data structure We intend to make more optimizations in the near future. (Aha and Breslow 1997).