Industry
Pedagogical Discourse: Connecting Students to Past Discussions and Peer Mentors within an Online Discussion Board
The goal of the Pedagogical Discourse project is to develop instructional tools that will help students and instructors use discussion boards more effectively, with an emphasis on automatically assessing discussion activities and building tools for promoting student discussion participation and learning. In this paper, we present a two related participation and learning scaffolding tools that exploit natural language processing and information retrieval techniques. The PedaBot tool is designed to aid student knowledge acquisition and promote reflection about course topics by connecting related discussions from a knowledge base of past discussions to the current discussion thread. The MentorMatch tool aims at promoting student participation using student mentors, i.e., course peers with a relatively good understanding of a particular topic. The system identifies students who often provide answers on a given topic and encourages classmates to invite mentors to participate in related discussions. Both tools have been integrated into a live discussion board that is used by an undergraduate computer science course. This paper describes our approaches to applying information retrieval and natural language processing techniques in the development of the tools and presents initial results from instrumentation and survey.
BioPlanner: A Plan Adaptation Approach for the Discovery of Biological Pathways across Species
Jin, Li (University of Delaware) | Decker, Keith S. (University of Delaware) | Schmidt, Carl J. (University of Delaware)
We present an implementation of a plan adaptation system, BioPlanner, built for biological pathway prediction across species. BioPlanner formulates a pathway discovery problem as a Hierarchical Task Network (HTN) planning problem and solves it by adapting a plan solution of another well-studied pathway. BioPlanner provides the following functionalities: It automatically builds HTN planning models for a biological pathway domain from the semantic web biological knowledge bases (KBs). It retrieves plan cases from the biological KBs. It generates hypothetical pathways using plan adaptation strategies with the aid of biological domain knowledge. It evaluates the hypothetical plan candidates, ranks them, and recommends the most likely hypotheses to users. It employs an information gathering multi-agent system to capture knowledge from heterogeneous sources to help the hypothetical plan generation process. We utilize BioPlanner to predict Signaling Transduction pathways for Mus musculus, Gallus gallus, and Drosophila melanogaster from Homo sapiens.
Learning by Demonstration to Support Military Planning and Decision Making
Garvey, Thomas (SRI International) | Gervasio, Melinda (SRI International) | Lee, Thomas (SRI International) | Myers, Karen (SRI International) | Angiolillo, Carl (General Dynamics C4 Systems) | Gaston, Matthew (General Dynamics C4 Systems) | Knittel, Janette (General Dynamics C4 Systems) | Kolojejchick, Jake (General Dynamics C4 Systems)
While the concept of learning by demonstration has been around for many years, recent advances in artificial intelligence technology have led to a resurgence of work in the field. We describe the development and application of learning by demonstration technology to support user creation of automated procedures for a rich collaborative planning environment that is in widespread use by the U.S. Army. User feedback and evaluation results show that the technology can be used effectively by the target user community and that it has tremendous potential for improving the speed and quality of performance for a range of critical tasks.
Trading Robustness for Privacy in Decentralized Recommender Systems
Cheng, Zunping (University College Dublin) | Hurley, Neil (University College Dublin)
Collaborative filtering (CF) recommender systems are very popular and successful in commercial application fields. One end-user concern is the privacy of the personal data required by such systems in order to make personalized recommendations. Recently, peer-to-peer decentralized architectures have been proposed to address this privacy issue. On the other hand system managers must be concerned about system robustness. In particular, it has been shown that recommender systems are vulnerable to profile injection, although model-based CF algorithms show greater stability against malicious attacks that have been studied in the state-of-the-art. In this paper we generalize the generic model for decentralized recommendation and discuss the trade-off between robustness and privacy. In this context, we argue that exposing knowledge of the model parameters allows new, highly effective, model-based attack strategies to be considered. We conclude that the security concerns of privacy and robustness stand in opposition to each other and are difficult to satisfy simultaneously.
An Agent-based Commodity Trading Simulation
Cheng, Shih-Fen (Singapore Management University) | Lim, Yee Pin (Singapore Management University)
In this paper, an event-centric commodity trading simulation powered by the multiagent framework is presented. The purpose of this simulation platform is for training novice traders. The simulation is progressed by announcing news events that affect various aspects of the commodity supply chain. Upon receiving these events, market agents that play the roles of producers, consumers, and speculators would adjust their views on the market and act accordingly. Their actions would be based on their roles and also their private information, and collectively they shape the market dynamics. This simulation has been effectively deployed for several training sessions. We will present the underlying technologies that are employed and discuss the practical significance of such platform.
Practical Attacks Against Authorship Recognition Techniques
Brennan, Michael Robert (Drexel University) | Greenstadt, Rachel (Drexel University)
The use of statistical AI techniques in authorship recognition (or stylometry) has contributed to literary and historical breakthroughs. These successes have led to the use of these techniques in criminal investigations and prosecutions. However, few have studied adversarial attacks and their devastating effect on the robustness of existing classification methods. This paper presents a framework for adversarial attacks including obfuscation attacks, where a subject attempts to hide their identity imitation attacks, where a subject attempts to frame another subject by imitating their writing style. The major contribution of this research is that it demonstrates that both attacks work very well. The obfuscation attack reduces the effectiveness of the techniques to the level of random guessing and the imitation attack succeeds with 68-91% probability depending on the stylometric technique used. These results are made more significant by the fact that the experimental subjects were unfamiliar with stylometric techniques, without specialized knowledge in linguistics, and spent little time on the attacks. This paper also provides another significant contribution to the field in using human subjects to empirically validate the claim of high accuracy for current techniques (without attacks) by reproducing results for three representative stylometric methods.
Simulation-based Optimization of Resource Placement and Emergency Response
Bjarnason, Ronald (Oregon State University) | Tadepalli, Prasad (Oregon State University) | Fern, Alan (Oregon State University) | Niedner, Carl (Coelo Company of Design)
Many city governments are under pressure to optimize the utilization of their resources to respond to fire, rescue and medical emergencies. In this paper we describe a simulation-based optimization software called SOFER that learns from a history of emergency requests to optimize the placement of resources and response policies. We describe a two-level random-restart hill climbing approach that yields policies which perform better than the current practice, satisfy the usability constraints, and are sensitive to optimization metrics and population changes. Some of the policies learned by the system give insight into response practices that would otherwise be counterintuitive.
Evaluating User-Adaptive Systems: Lessons from Experiences with a Personalized Meeting Scheduling Assistant
Berry, Pauline M. (SRI International) | Donneau-Golencer, Thierry (SRI International) | Duong, Khang (SRI International) | Gervasio, Melinda (SRI International) | Peintner, Bart (SRI International) | Yorke-Smith, Neil (SRI International)
We discuss experiences from evaluating the learning performance of a user-adaptive personal assistant agent. We discuss the challenge of designing adequate evaluation and the tension of collecting adequate data without a fully functional, deployed system. Reflections on negative and positive experiences point to the challenges of evaluating user-adaptive AI systems. Lessons learned concern early consideration of evaluation and deployment, characteristics of AI technology and domains that make controlled evaluations appropriate or not, holistic experimental design, implications of "in the wild" evaluation, and the effect of AI-enabled functionality and its impact upon existing tools and work practices.
Archiving the Semantics of Digital Engineering Artifacts in CIBER-U
Regli, William C. (Drexel University) | Grauer, Michael (Drexel University) | Kopena, Joseph (Drexel University) | Wilkie, David (University of North Carolina) | Piecyk, Martin (Drexel University) | Osecki, Jordan (Drexel University)
This paper introduces the challenge of digital preservation in the area of engineering design and manufacturing and presents a methodology to apply knowledge representation and semantic techniques to develop Digital Engineering Archives. This work is part of an ongoing, multi-university, effort to create Cyber-Infrastructure-Based Engineering Repositories for Undergraduates (CIBER-U) to support engineering design education. The technical approach is to use knowledge representation techniques to create formal models of engineering data elements, workflows and processes. With these formal engineering knowledge and processes can be captured and preserved with some guarantee of long-term interpretability. The paper presents examples of how the techniques can be used to encode specific engineering information packages and workflows. These techniques are being integrated into a semantic Wiki that supports the CIBER-U engineering education activities across nine universities and involving over 3,500 students since 2006.
Enabling Data Quality with Lightweight Ontologies
Bidlack, Clint R. (ActivePrime Inc.)
As the volume and interconnectedness of corporate data grows, data quality is becoming a business competency essential to success. Existing methods for managing data quality do not scale up to large volumes of data in a way that is directly manageable by the owner of the data. For the past two years a new breed of data quality products, built on applied AI techniques, are empowering non-technical users. Over 150 businesses are benefiting from these products including NASDAQ, Visa, Experian, Oracle, Fidelity, Bank of America, Volvo, Dell, Sabic, and Dassault Systems. The applied AI techniques described include lightweight ontologies to efficiently find inexact textual matches in large data sets.