Memory-Based Learning
Using Machine Learning to Improve Stochastic Optimization
Wolpert, David (Santa Fe Institute) | Rajnarayan, Dev (Sensor Platforms Inc.)
In many stochastic optimization algorithms there is a hyperparameter that controls how the next sampling distribution is determined from the current data set of samples of the objective function. This hyperparameter controls the exploration/exploitation trade-off of the next sample. Typically heuristic "rules of thumb" are used to set that hyperparameter, e.g., a pre-fixed annealing schedule. We show how machine learning provides more principled alternatives to (adaptively) set that hyperparameter, and demonstrate that these alternatives can substantially improve optimization performance.
Case-Based Meta-Prediction for Bioinformatics
Yun, Xi (The Graduate Center of The City University of New York) | Epstein, Susan L. (The Graduate Center and Hunter College of The City University of New York) | Han, Weiwei (Jilin University) | Xie, Lei (The Graduate Center and Hunter College of The City University of New York)
Before laboratory testing, bioinformatics problems often require a machine-learned predictor to identify the most likely choices among a wealth of possibilities. Researchers may advocate different predictors for the same problem, none of which is best in all situations. This paper introduces a case-based meta-predictor that combines a set of elaborate, pre-existing predictors to improve their accuracy on a difficult and important problem: protein-ligand docking. The method focuses on the reliability of its component predictors, and has broad potential applications in biology and chemistry. Despite noisy and biased input, the method outperforms its individual components on benchmark data. It provides a promising solution for the performance improvement of compound virtual screening, which would thereby reduce the time and cost of drug discovery.
Model-Lite Case-Based Planning
Zhuo, Hankz Hankui (Sun Yat-sen University) | Nguyen, Tuan (Arizona State University) | Kambhampati, Subbarao (Arizona State University)
There is increasing awareness in the planning community that depending on complete models impedes the applicability of planning technology in many real world domains where the burden of specifying complete domain models is too high. In this paper, we consider a novel solution for this challenge that combines generative planning on incomplete domain models with a library of plan cases that are known to be correct. While this was arguably the original motivation for case-based planning, most existing case-based planners assume (and depend on) from-scratch planners that work on complete domain models. In contrast, our approach views the plan generated with respect to the incomplete model as a ``skeletal plan'' and augments it with directed mining of plan fragments from library cases. We will present the details of our approach and present an empirical evaluation of our method in comparison to a state-of-the-art case-based planner that depends on complete domain models.
What a Shame — Why Good Ideas Can’t Make It in Architecture: A Contemporary Approach towards the Case-Based Reasoning Paradigm in Architecture
Richter, Katharina (Bauhaus-University Weimar)
The paper deals with the application of the Case-Based Reasoning Paradigm (CBR) in Design Support Systems in Architecture. Based on the finding that promising concepts and systems do exist in architecture the question as to why they do not gain the anticipated success is explored. In search for reasons a comprehensive comparison between the cognitive model and the derived conceptual method, theoretical contemplations of architectural design as well as the actual application of the method in CBR systems in Architecture, manifests the core of the work presented.
Modeling Competence for Case Based Reasoning Systems Using Clustering
Smiti, Abir (LARODEC, Université de Tunis, Tunisia) | Elouedi, Zied (LARODEC, Université de Tunis, Tunisia)
The success of the Case Based Reasoning (CBR) system depends on the quality of the case data. This quality is dedicated to the study of the case base competence which is measured by the range of problems that can be satisfactorily solved. In fact, modeling case-base competence is a clamorous issue in the discipline of CBR. However, the existence of erroneous cases as noises and the non uniform problem distributions has not been considered in the proposed computing competence. In this paper, we proposea novel case base competence model based on Mahalanobis distance and a clustering technique named DBSCAN-GM. The advantage of this newly proposed model is its high accuracy for predictingcompetence. In addition, it is not sensitive to noisy cases and it takes account the situation of the distributed case-base.Withal, we contest that this model has aconspicuous role to play in future CBR research infields such as the development of new policies for maintainingthe case base.
Learning from Demonstration to Be a Good Team Member in a Role Playing Game
Silva, Michael (PARC, A Xerox Company) | McCroskey, Silas (PARC, A Xerox Company) | Rubin, Jonathan (PARC, A Xerox Company) | Youngblood, Michael (PARC, A Xerox Company) | Ram, Ashwin (PARC, A Xerox Company)
We present an approach that uses learning from demonstration in a computer role playing game to create a controller for a companion team member. We describe a behavior engine that uses case-based reasoning. The behavior engine accepts observation traces of human playing decisions and produces a sequence of actions which can then be carried out by an artificial agent within the gaming environment. Our work focuses on team-based role playing games, where the agents produced by the behavior engine act as team members within a mixed human-agent team. We present the results of a study we conducted, where we assess both the quantitative and qualitative performance difference between human-only teams compared with hybrid human-agent teams. The results of our study show that human-agent teams were more successful at task completion and, for some qualitative dimensions, hybrid teams were perceived more favorably than human-only teams.
Analysis and Cleaning of User Traces Through Comparison of Multiple Traces
Floyd, Michael William (Carleton University) | Esfandiari, Babak (Carleton University)
Traces of user behaviour can be a valuable source of knowledge that can be used during case-based reasoning. This paper presents an approach for analyzing and cleaning user traces. The analysis looks to identify three properties in traces: reasoning with an internal state, non-deterministic behaviour and error. The existence of any of these properties may influence how a system should reason or store knowledge in cases. Initially, each trace is examined to see areas that might contain one of the three properties. Multiple versions of the trace are then generated in order to determine which specific property is present. The analysis is applied to traces generated by observing both a computer and human controller for an obstacle avoidance robot. The results demonstrate that the analysis is able to successfully identify which properties are present and clean many of the errors that exist in the traces.
Trace-Based Reasoning — Modeling Interaction Traces for Reasoning on Experiences
Cordier, Amélie (University of Lyon, CNRS) | Lefevre, Marie (University of Lyon, CNRS) | Champin, Pierre-Antoine (University of Lyon, CNRS) | Georgeon, Olivier (University of Lyon, CNRS) | Mille, Alain (University of Lyon, CNRS)
This paper addresses Trace-Based Reasoning (TBR) by using Case-Based Reasoning (CBR) as a descriptive framework. TBR is a reasoning paradigm in which inferences are made on specific objects called traces. Traces are sequential records of events observed and stored during an interactive process. We report two contributions. First, we propose a review of the current researches related to TBR. Then, we compare CBR and TBR. From this comparison, we show that the exploitation of traces instead of cases as knowledge sources raises very specific challenges. More precisely, new methods for defining similarity measures and for performing adaptation of traces are required. These new methods have to take into account the sequential properties of traces. We emphasis the benefits of using traces as a knowledge container in a reasoning process and we pinpoint promising applications of TBR.
Case-Based Reasoning: A Concise Introduction
Case-based reasoning is a methodology with a long tradition in artificial intelligence that brings together reasoning and machine learning techniques to solve problems based on past experiences or cases. Given a problem to be solved, reasoning involves the use of methods to retrieve similar past cases in order to reuse their solution for the problem at hand. Once the problem has been solved, learning methods can be applied to improve the knowledge based on past experiences. In spite of being a broad methodology applied in industry and services, case-based reasoning has often been forgotten in both artificial intelligence and machine learning books. The aim of this book is to present a concise introduction to case-based reasoning providing the essential building blocks for the design of case-based reasoning systems, as well as to bring together the main research lines in this field to encourage students to solve current CBR challenges.