Country
Representing Context Using the Context for Human and Automation Teams Model
Ganberg, Gabriel (Aptima, Inc.) | Ayers, Jeanine (Aptima, Inc.) | Schurr, Nathan (Aptima, Inc.) | Therrien, Michael (Aptima, Inc.) | Rousseau, Jeff (Aptima, Inc.)
The goal of representing context in a mixed initiative sys-tem is to model the information at a level of abstraction that is actionable for both the human and automated system. A potential solution to this problem is the Context for Human and Automation Teams (CHAT). This paper introduces the CHAT model and provides example implementations from several different applications such as task scheduling tech-niques, multi-agent systems, and human-robot interaction.
Visualizing and Understanding Large-Scale Bayesian Networks
Cossalter, Michele (Carnegie Mellon University) | Mengshoel, Ole (Carnegie Mellon University) | Selker, Ted (Carnegie Mellon University)
Bayesian networks are a theoretically well-founded approach to represent large multi-variate probability distributions, and have proven useful in a broad range of applications. While several software tools for visualizing and editing Bayesian networks exist, they have important weaknesses when it comes to enabling users to clearly understand and compare conditional probability tables in the context of network topology, especially in large-scale networks. This paper describes a system for improving the ability for computers to work with people to develop intelligent systems through the construction of high-performing Bayesian networks. We describe NetEx, a tool developed as a Cytoscape plug-in, which allows a user to visually inspect and compare details concerning multiple nodes in a Bayesian network while maintaining awareness of their network context. It uses a "thought bubble line" to connect nodes in a graph representation and their internal information at the side of the graph. The tool seeks to improve the ability of experts to analyze and debug large Bayesian network models, and to help people to understand how alternative algorithms and Bayesian networks operate, providing insights into how to improve them.
An Extendable Toolkit for Managing Quality of Human-Based Electronic Services
Bermbach, David (Karlsruhe Institute of Technology) | Kern, Robert (Karlsruhe Institute of Technology) | Wichmann, Pascal (Karlsruhe Institute of Technology) | Rath, Sandra (Karlsruhe Institute of Technology) | Zirpins, Christian (Karlsruhe Institute of Technology)
Micro-task markets like Amazon MTurk enable online workers to provide human intelligence as Web-based on demand services (so called "people services"). Businesses facing large amounts of knowledge work can benefit from increased flexibility and scalability of their workforce but need to cope with reduced control of result quality. While this problem is well recognized, it has so far only rudimentarily been addressed by existing platforms and tools. In this paper, we present a flexible research toolkit which enables experiments with advanced quality management mechanisms for generic micro-task markets. The toolkit enables control of correctness and performance of task fulfillment by means of continuous sampling, dynamic majority voting and worker pooling. While we demonstrate its application and performance for an OCR scenario building on Amazon MTurk, the toolkit supports the development of advanced quality management mechanisms for a large variety of people service scenarios and platforms.
User-Adaptive Visualizations: Can Gaze Data Tell Us When a User Needs Them?
Conati, Cristina (University of British Columbia) | Carenini, Giuseppe (University of British Columbia) | Harati, Mona (University of British Columbia) | Tocker, Dereck (University of British Columbia) | Fitzgerald, Nicholas (University of British Columbia) | Flagg, Anna (University of British Columbia)
The primary goal of our research is to design adaptive information visualization systems that adapt to the specific needs of each individual viewer. Our first step is to explore data sources that could help detect these needs in real-time, including cognitive measures that impact perceptual abilities, interface interactions, eye-tracking, and physiological sensors. In this paper, we focus on current efforts to understand which cognitive measures can be relevant, as well as if/how a viewerโs gaze pattern can predict performance on associated visualization task.
Human-Driven Spatial Language for Human-Robot Interaction
Skubic, Marjorie (University of Missouri) | Huo, Zhiyu (University of Missouri) | Carlson, Laura (University of Notre Dame) | Li, Xiao Ou (University of Notre Dame) | Miller, Jared (University of Notre Dame)
This extended abstract outlines a new study that investigates spatial language for use in human-robot communication. The scenario studied is a home setting in which the elderly resident has misplaced an object, such as eyeglasses, and the robot will help the resident find the object. We present preliminary results from the initial study in which we investigate spatial language generated to a human addressee or a robot addressee in a virtual environment.
Whatโs the Right Price? Pricing Tasks for Finishing on Time
Faradani, Siamak (University of California, Berkeley) | Hartmann, Bjoern (University of California, Berkeley) | Ipeirotis, Panagiotis G. (New York University)
Many practitioners currently use rules of thumb to price tasks on online labor markets. Incorrect pricing leads to task starvation or inefficient use of capital. Formal pricing policies can address these challenges. In this paper we argue that a pricing policy can be based on the trade-off between price and desired completion time.We show how this duality can lead to a better pricing policy for tasks in online labor markets. This paper makes three contributions. First, we devise an algorithm for job pricing using a survival analysis model. We then show that worker arrivals can be modeled as a non-homogeneous Poisson Process (NHPP). Finally using NHPP for worker arrivals and discrete choice models we present an abstract mathematical model that captures the dynamics of the market when full market information is presented to the task requester. This model can be used to predict completion times and pricing policies for both public and private crowds.
Modeling Socio-Cultural Phenomena in Online Multi-Party Discourse
Strzalkowski, Tomek (State University of New York - Albany and Polish Academy of Sciences) | Broadwell, George Aaron (State University of New York - Albany) | Stromer-Galley, Jennifer ( State University of New York - Albany ) | Shaikh, Samira (State University of New York - Albany) | Liu, Ting (State University of New York - Albany) | Taylor, Sarah (Lockheed Martin)
We present in this paper, the application of a novel approach to computational modeling, understanding and detection of social phenomena in online multi-party discourse. A two-tiered approach was developed to detect a collection of social phenomena deployed by participants, such as topic control, task control, disagreement and involvement. We discuss how the mid-level social phenomena can be reliably detected in discourse and these measures can be used to differentiate participants of online discourse. Our approach works across different types of online chat and we show results on two specific data sets.
Activized Learning: Transforming Passive to Active with Improved Label Complexity
We study the theoretical advantages of active learning over passive learning. Specifically, we prove that, in noise-free classifier learning for VC classes, any passive learning algorithm can be transformed into an active learning algorithm with asymptotically strictly superior label complexity for all nontrivial target functions and distributions. We further provide a general characterization of the magnitudes of these improvements in terms of a novel generalization of the disagreement coefficient. We also extend these results to active learning in the presence of label noise, and find that even under broad classes of noise distributions, we can typically guarantee strict improvements over the known results for passive learning.
Multi-Task Learning in Heterogeneous Feature Spaces
Zhang, Yu (Hong Kong University of Science and Technology) | Yeung, Dit-Yan (Hong Kong University of Science and Technology)
Multi-task learning aims at improving the generalization performance of a learning task with the help of some other related tasks. Although many multi-task learning methods have been proposed, they are all based on the assumption that all tasks share the same data representation. This assumption is too restrictive for general applications. In this paper, we propose a multi-task extension of linear discriminant analysis (LDA), called multi-task discriminant analysis (MTDA), which can deal with learning tasks with different data representations. For each task, MTDA learns a separate transformation which consists of two parts, one specific to the task and one common to all tasks. A by-product of MTDA is that it can alleviate the labeled data deficiency problem of LDA. Moreover, unlike many existing multi-task learning methods, MTDA can handle binary and multi-class problems for each task in a generic way. Experimental results on face recognition show that MTDA consistently outperforms related methods.