University of California, Santa Cruz
CADI — A Conversational Assistive Design Interface for Discovering Pong Variants
Mobramaein, Afshin (University of California, Santa Cruz) | Behrooz, Morteza (University of California, Santa Cruz) | Whitehead, Jim (University of California, Santa Cruz)
Mixed-initiative PCG systems provide a way to leverage the expressive power of algorithmic techniques for content generation in a manner that lowers the technical barrier for content creators. While these tools are a proof of concept of how PCG systems can aide aspiring designers reach their vision, there are issues pertaining capturing designer intent, and interface complexity. In this paper we introduce CADI (Conversational Assistive Design Interface) a mixed initiative PCG system for creating variations of the game Pong that utilizes natural language input through a natural language interface to explore the design space of Pong variations. We provide a motivation for the creation of CADI and discuss the implementation and design decisions taken to address the issues of designer intent and interface complexity in mixed-initiative PCG systems.
The 13th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment
Magerko, Brian (Georgia Institute of Technology) | Bahamón, Julio César (University of North Carolina at Charlotte) | Buro, Michael (University of Alberta) | Damiano, Rossana (University of Turin) | Mazeika, Jo (University of California, Santa Cruz) | Ontañón, Santiago (Drexel University) | Robertson, Justus (North Carolina State University) | Ryan, James (University of California, Santa Cruz) | Siu, Kristin (Georgia Institute of Technology)
The 13th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE 2017) was held at the Snowbird Ski and Summer Resort in Little Cottonwod Canyon in the Wasatch Range of the Rock Mountains near Salt Lake County, Utah. Along with the main conference presentations, the meeting included two tutorials, three workshops, and invited keynotes. This report summarizes the main conference. It also includes contributions from the organizers of the three workshops.
Fairness-Aware Relational Learning and Inference
Farnadi, Golnoosh (University of California, Santa Cruz) | Babaki, Behrouz (KU Leuven) | Getoor, Lise (University of California, Santa Cruz)
AI and machine learning tools are being used with increasing frequency for decision making in domains that affect peoples' lives such as employment, education, policing and loan approval. These uses raise concerns about biases of algorithmic discrimination and have motivated the development of fairness-aware machine learning. However, existing fairness approaches are based solely on attributes of individuals. In many cases, discrimination is much more complex, and taking into account the social, organizational, and other connections between individuals is important. We introduce new notions of fairness that are able to capture the relational structure in a domain. We use first-order logic to provide a flexible and expressive language for specifying complex relational patterns of discrimination. We incorporate our definition of relational fairness to propose 1) fairness-aware constrained conditional inference subject to common data-oriented fairness measures and 2) fairness-aware parameter learning by incorporating decision-oriented fairness measures.
Learning User Intent from Action Sequences on Interactive Systems
Agrawal, Rakshit (University of California, Santa Cruz) | Habeeb, Anwar (Stubhub) | Hsueh, Chih-Hsin (Stubhub)
Interactive systems have taken over the web and mobile space with increasing participation from users. Applications across every marketing domain can now be accessed through mobile or web where users can directly perform certain actions and reach a desired outcome. Actions of user on a system, though, can be representative of a certain intent. Ability to learn this intent through user's actions can help draw certain insight into the behavior of users on a system. In this paper, we present models to optimize interactive systems by learning and analyzing user intent through their actions on the system. We present a four phased model that uses time-series of interaction actions sequentially using a Long Short-Term Memory (LSTM) based sequence learning system that helps build a model for intent recognition. Our system then provides an objective specific maximization followed by analysis and contrasting methods in order to identify spaces of improvement in the interaction system. We discuss deployment scenarios for such a system and present results from evaluation on an online marketplace using user clickstream data.
Towards Inductive Logic Programming for Game Analysis: Leda
Summerville, Adam (University of California, Santa Cruz)
Game generation and analysis has commonly relied on hand authored rules and heuristics. This authoring task comes with a high authorial burden, both in the amount of rules and heuristics that need to be authored for decent coverage and in the complexity of authoring these rules. In this paper I present early work on \textit{Leda} and inductive logic programming system designed to learn these rules, so as to support further generation and analysis. I present Leda, describe its process, and finally show a sample set of the rules that it learns.
Talk to Me About Pong: On Using Conversational Interfaces for Mixed-Initiative Game Design
Mobramaein, Afshin (University of California, Santa Cruz) | Whitehead, Jim (University of California, Santa Cruz) | Chakraborttii, Chandranil (University of California, Santa Cruz)
Mixed-initiative game design tools combine intelligent agents and human input as collaboration to create novel and interesting content. Traditionally, these systems utilize graphical control-based interfaces. These interfaces can be complex and not reflective of designer intent. Given these issues we propose exploring conversational interfaces for mixed-initiative game design tools. We propose a case-study involving a system for co-creating variations of the game Pong as an initial step towards the exploration of the topic. In addition, we present some of the issues involving the design and implementation of conversational interfaces in mixed-initiative game design tools.
How Can I Cook with This: User Experience Challenges for AI in the Home Kitchen
Pagnutti, Johnathan (University of California, Santa Cruz)
Artificial Intelligence has had an outsized impact on our daily lives, from curating the movies we watch to recommending the books we read. There has been an interest in bringing AI techniques to the kitchen since long before the modern resurgence in AI interest. This is a domain filled with potential victories, with technologies and techniques that are applicable to nearly everyone. In planning a meal, grocery shopping, and even meal preparation, computational systems can assist and empower people to make healthier choices. However, this domain has a unique set of UI and UX challenges that need to be considered that separate it from other applications of artificial intelligence.
MTG: Context-Based Music Composition for Tabletop Role-Playing Games
Ferreira, Lucas N. (University of California, Santa Cruz) | Whitehead, Jim (University of California, Santa Cruz)
This project aims to compose background music in real-time for tabletop role-playing games. To accomplish this goal, we propose a system called MTG that listens to players' speeches in order to recognize the context of the current scene and generate background music to match the scene. A speech recognition system is used to transcribe players' speeches to text and a supervised learning algorithm detects when scene transitions take place. In its current version, a scene transition occurs whenever the emotional state of the narrative changes. Moreover, the background music is not generated, but selected based on its emotion from a library of hand-authored pieces. As future work, we plan to generate the background music considering the current scene context and the probability of scene transition. We also consider to retrieve more information from the narrative to detect scene transitions, such as the scene's location and time of the day as well as actions taken by characters.
Towards General RPG Playing
Osborn, Joseph C. (University of California, Santa Cruz) | Samuel, Ben (University of New Orleans) | Summerville, Adam (University of California, Santa Cruz) | Mateas, Michael (University of California, Santa Cruz)
General videogame playing has come a long way in a short period of time, but remains at the level of solving relatively short games made up of distinct and isolated episodes. Even simple console role-playing games (RPGs) are far beyond the reach of current techniques, requiring the synthesis of cultural knowledge with compositional reasoning over several interconnected sub-games. We explore how the challenges of playing these games could spark new advances in compositional analysis of games and common-sense reasoning. General RPG playing can leverage advances in episodic general game playing and in areas like text understanding, image classification, and automated game design learning. It has direct applications in design support and AI-based game design, and the techniques used to enable it could generalize to other families of games such as adventure, open-world, and simulation games. In this paper, we describe the motivation behind general RPG playing in a sub-domain of Nintendo Entertainment System (NES) RPGs, some promising approaches to some of its fundamental issues, and immediate next steps; we conclude by describing a few concrete benchmark problems on the path towards automated play of these complex games.
Playable Experiences at AIIDE 2017
Treanor, Mike (American University) | Warren, Nicholas (University of California, Santa Cruz) | Reed, Mason (University of California, Santa Cruz) | Smith, Adam M. (University of California, Santa Cruz) | Ortiz, Pablo (Massachusetts Institute of Technology) | Coney, Laurel (Massachusetts Institute of Technology) | Sherman, Loren (Massachusetts Institute of Technology) | Carré, Elizabeth ( Massachusetts College of Art and Design ) | Vivatvisha, Nadya ( Harvard University ) | Harrell, D. Fox (Massachusetts Institute of Technology) | Mardo, Paola ( University of Southern California ) | Gordon, Andrew (University of Southern California) | Dormans, Joris (Ludomotion) | Robison, Barrie (Polymorphic Games) | Gomez, Spencer (University of Idaho) | Heck, Samantha (University of Idaho) | Wright, Landon (University of Idaho) | Soule, Terence (University of Idaho)