Real-time heuristic search algorithms obey a constant limit on planning time per move. Agents using these algorithms can execute each move as it is computed, suggesting a strong potential for application to real-time video-game AI. Recently, a breakthrough in real-time heuristic search performance was achieved through the use of case-based reasoning. In this framework, the agent optimally solves a set of problems and stores their solutions in a case base. Then, given any new problem, it seeks a similar case in the case base and uses its solution as an aid to solve the problem at hand. A number of ad hoc approaches to the case base formation problem have been proposed and empirically shown to perform well. In this paper, we investigate a theoretically driven approach to solving the problem. We mathematically relate properties of a case base to the suboptimality of the solutions it produces and subsequently develop an algorithm that addresses these properties directly. An empirical evaluation shows our new algorithm outperforms the existing state of the art on contemporary video-game pathfinding benchmarks.

Bot detection is an emerging problem in social games that requires different approaches from those used in massively multi-player online games (MMOGs). We focus on mouse selections as a key element of bot detection. We hypothesize that certain interface elements result in predictable differences in mouse selections, which we call spatial game signatures, and that those signatures can be used to model player interactions that are specific to the game mechanics and game interface. We performed a study in which users played a game representative of social games. We collected in-game actions, from which we empirically identified these signatures, and show that these signatures result in a viable approach to bot detection. We make three contributions. First, we introduce the idea of spatial game signatures. Second, we show that the assumption that mouse clicks are normally distributed about the center of buttons is not true for every interface element. Finally, we provide methodologies for using spatial game signatures for bot detection.

Many computer games of all genres pit the player against a succession of increasingly difficult challenges such as combat with computer-controlled enemies and puzzles. Part of the fun of computer games is to master the skills necessary to complete the game. Challenge tailoring is the problem of matching the difficulty of skill-based events over the course of a game to a specific player's abilities. We present a tensor factorization approach to predicting player performance in skill-based computer games. Our tensor factorization approach is data-driven and can predict changes in players' skill mastery over time, allowing more accurate tailoring of challenges. We demonstrate the efficacy and scalability of tensor factorization models through an empirical study of human players in a simple role-playing combat game. We further find a significant correlation between these performance ratings and player subjective experiences of difficulty and discuss ways our model can be used to optimize player enjoyment.

However, due to the small numbers of goals present in existing systems, goal management Autonomous AI systems should be aware of their own goals is a relatively simple affair. Hanheide et al. (2010) describe and be capable of independently formulating behaviour to a system similar in architecture to our own that manages address them. We would ideally like to provide an agent with just two goals, whereas the one discussed in this paper must a collection of competences that allow it to act in novel situations manage upwards of forty. As the number of goals increases, that may not be predictable at design-time. In particular, the potential for goal conflict grows. This leads to a requirement we are interested in the operation of AI systems in for more sophisticated management processes, such as complex, oversubscribed domains where there may exist a dynamic goal re-prioritisation, allowing agents to alter their variety of ways to address high-level goals by composing behaviour to meet changing operational requirements. In the behaviours to achieve a set of sub-goals taken from a larger oversubscribed problem domains we are interested in, encoding set. Our research focusses how such sub-goals might be chosen all possible operating strategies at design time may (i.e.

Spatiotemporal reasoning is a fundamental contributor to effective problem solving. In an effort to design better problem-solving agents, we examined and evaluated the strategies that humans use to solve Tower Defense puzzles, a complex and popular class of real-time strategy games. A consistent and unexpected finding was that humans frequently treated time and space as equivalent. Players stated temporal goals but solved spatial problems. An analysis of human data and computer simulations showed that re-representing temporal problems as spatial problems was beneficial, but treating the two separately can lead to higher scores. The work presented here holds several possibilities for level designers and others who design and analyze maps and spatial arrangements for domains requiring strategic reasoning.

Morals are an important part of many stories, and central to why storytelling developed in the first place as a means of communication. They have the potential to provide a framework for developing story structure, which could be utilised by modern storytelling systems. To achieve this we need a general representation for morals. We propose patterns of character emotion as a suitable foundation. In this paper, we categorise Aesop’s fables based on the morals they convey, and use them as a source of emotion data corresponding to those morals. We use inductive logic programming to identify relationships between particular patterns of emotion and the morals of the stories in which they arise.

Search-based procedural content generation methods allow video games to introduce new content continually, thereby engaging the player for a longer time while reducing the burden on developers. However, games so far have not explored the potential economic value of unique evolved artifacts. Building on this insight, this paper presents for the first time a Facebook game called Petalz in which players can share flowers they breed themselves with other players through a global marketplace. In particular, the market in this social game allows players to set the price of their evolved aesthetically-pleasing flowers in virtual currency. Furthermore, the transaction in which one player buys seeds from another creates a new social element that links the players in the transaction. The combination of unique user-generated content and social gaming in Petalz facilitates meaningful collaboration between users, positively influences the dynamics of the game, and opens new possibilities in digital entertainment.

Speech recognition failures and limited vocabulary coverage pose challenges for speech interaction with characters in games. We describe an end-to-end system for automating characters from a large corpus of recorded human game logs, and demonstrate that inferring utterance meaning through a combination of plan recognition and surface text similarity compensates for recognition and understanding failures significantly better than relying on surface similarity alone.

The creative nature of games makes trying new ideas desirable, but these changes are sometimes very risky. We need to find ways to minimize risks while we build innovative experiences. Driver San Francisco did this by using Hinted-execution Behavior Trees; this technique allows developers to modify existing AI behaviors dynamically with very low risk, and was used to adapt Driver’s getaway AI to players’ skills.

We present POMCoP, a system for online planning in collaborative domains that reasons about how its actions will affect its understanding of human intentions, and demonstrate its use in building sidekicks for cooperative games. POMCoP plans in belief space. It explicitly represents its uncertainty about the intentions of its human ally, and plans actions which reveal those intentions or hedge against its uncertainty. This allows POMCoP to reason about the usefulness of incorporating information gathering actions into its plans, such as asking questions, or simply waiting to let humans reveal their intentions. We demonstrate POMCoP by constructing a sidekick for a cooperative pursuit game, and evaluate its effectiveness relative to MDP-based techniques that plan in state space, rather than belief space.