Instructional Material
The Case for Case-Based Transfer Learning
Klenk, Matthew (Navy Center for Applied Research in Artificial Intelligence) | Aha, David W. (Navy Center for Applied Research in Artificial Intelligence) | Molineaux, Matt (Knexus Research Corporation)
Case-based reasoning (CBR) is a problem-solving process in which a new problem is solved by retrieving a similar situation and reusing its solution. Transfer learning occurs when, after gaining experience from learning how to solve source problems, the same learner exploits this experience to improve performance and/or learning on target problems. In transfer learning, the differences between the source and target problems characterize the transfer distance. CBR can support transfer learning methods in multiple ways. We illustrate how CBR and transfer learning interact and characterize three approaches for using CBR in transfer learning: (1) as a transfer learning method, (2) for problem learning, and (3) to transfer knowledge between sets of problems. We describe examples of these approaches from our own and related work and discuss applicable transfer distances for each. We close with conclusions and directions for future research applying CBR to transfer learning.
Representing Biological Processes in Modular Action Language ALM
Inclezan, Daniela (Texas Tech University) | Gelfond, Michael (Texas Tech University)
This paper presents the formalization of a biological process, cell division, in modular action language ALM. We show how the features of ALM โ modularity, separation between an uninterpreted theory and its interpretation โ lead to a simple and elegant solution that can be used in answering questions from biology textbooks.
Design Patterns and Cross-Domain Analogies in Biologically Inspired Sustainable Design
Goel, Ashok K. (Georgia Institute of Technology) | Bras, Bert (Georgia Institute of Technology) | Helms, Michael (Georgia Institute of Technology) | Rugaber, Spencer (Georgia Institute of Technology) | Tovey, Craig (Georgia Institute of Technology) | Vattam, Swaroop (Georgia Institute of Technology) | Weissburg, Marc (Georgia Institute of Technology) | Wiltgen, Bryan (Georgia Institute of Technology) | Yen, Jeannette (Georgia Institute of Technology)
Sustainable design is as an important movement in design. Biologically inspired design is a major paradigm for sustainable design. In this paper, we analyze a corpus of biologically inspired design projects in terms of sustainability. We then describe a case study of analogical design of a fog harvesting net, and abstract from it the patterns of Hydrophobia and Hydrophilia. We indicate how these two function-mechanism design patterns occur in several design projects in our corpus. This analysis indicates how biologically inspired sustainable design can be analyzed in terms of cross-domain analogical transfer of design patterns.
PATSy and VL-PATSy: Online Case-Based Training for Healthcare Professionals
Cox, Richard J. (University of Edinburgh)
This paper describes PATSy, an online repository of virtual patient cases for training and research for >students and practitioners in the clinical sciences. A typical student session with PATSy is illustrated. An extension to PATSy that adds vicarious learning resources (VL-PATSy) is also described. The concept of vicarious learning is outlined and results from a study of learning outcomes from VL-PATSy are presented. PATSy and VL-PATSy will be demonstrated at the symposium.
Evidence Feed Forward Hidden Markov Model: A New Type of Hidden Markov Model
DelRose, Michael, Wagner, Christian, Frederick, Philip
The ability to predict the intentions of people based solely on their visual actions is a skill only performed by humans and animals. The intelligence of current computer algorithms has not reached this level of complexity, but there are several research efforts that are working towards it. With the number of classification algorithms available, it is hard to determine which algorithm works best for a particular situation. In classification of visual human intent data, Hidden Markov Models (HMM), and their variants, are leading candidates. The inability of HMMs to provide a probability in the observation to observation linkages is a big downfall in this classification technique. If a person is visually identifying an action of another person, they monitor patterns in the observations. By estimating the next observation, people have the ability to summarize the actions, and thus determine, with pretty good accuracy, the intention of the person performing the action. These visual cues and linkages are important in creating intelligent algorithms for determining human actions based on visual observations. The Evidence Feed Forward Hidden Markov Model is a newly developed algorithm which provides observation to observation linkages. The following research addresses the theory behind Evidence Feed Forward HMMs, provides mathematical proofs of their learning of these parameters to optimize the likelihood of observations with a Evidence Feed Forwards HMM, which is important in all computational intelligence algorithm, and gives comparative examples with standard HMMs in classification of both visual action data and measurement data; thus providing a strong base for Evidence Feed Forward HMMs in classification of many types of problems.
Learning Hidden Markov Models using Non-Negative Matrix Factorization
Cybenko, George, Crespi, Valentino
The Baum-Welsh algorithm together with its derivatives and variations has been the main technique for learning Hidden Markov Models (HMM) from observational data. We present an HMM learning algorithm based on the non-negative matrix factorization (NMF) of higher order Markovian statistics that is structurally different from the Baum-Welsh and its associated approaches. The described algorithm supports estimation of the number of recurrent states of an HMM and iterates the non-negative matrix factorization (NMF) algorithm to improve the learned HMM parameters. Numerical examples are provided as well.
Learning to combine foveal glimpses with a third-order Boltzmann machine
Larochelle, Hugo, Hinton, Geoffrey E.
We describe a model based on a Boltzmann machine with third-order connections that can learn how to accumulate information about a shape over several fixations. The model uses a retina that only has enough high resolution pixels to cover a small area of the image, so it must decide on a sequence of fixations and it must combine the glimpse" at each fixation with the location of the fixation before integrating the information with information from other glimpses of the same object. We evaluate this model on a synthetic dataset and two image classification datasets, showing that it can perform at least as well as a model trained on whole images."
Label Embedding Trees for Large Multi-Class Tasks
Bengio, Samy, Weston, Jason, Grangier, David
Multi-class classification becomes challenging at test time when the number of classes is very large and testing against every possible class can become computationally infeasible. This problem can be alleviated by imposing (or learning) a structure over the set of classes. We propose an algorithm for learning a tree-structure of classifiers which, by optimizing the overall tree loss, provides superior accuracy to existing tree labeling methods. We also propose a method that learns to embed labels in a low dimensional space that is faster than non-embedding approaches and has superior accuracy to existing embedding approaches. Finally we combine the two ideas resulting in the label embedding tree that outperforms alternative methods including One-vs-Rest while being orders of magnitude faster.
An Alternative to Low-level-Sychrony-Based Methods for Speech Detection
Movellan, Javier R., Ruvolo, Paul L.
Determining whether someone is talking has applications in many areas such as speech recognition, speaker diarization, social robotics, facial expression recognition, andhuman computer interaction. One popular approach to this problem is audiovisual synchrony detection [10, 21, 12]. A candidate speaker is deemed to be talking if the visual signal around that speaker correlates with the auditory signal. Here we show that with the proper visual features (in this case movements of various facial muscle groups), a very accurate detector of speech can be created thatdoes not use the audio signal at all. Further we show that this person independent visual-only detector can be used to train very accurate audio-based person dependent voice models. The voice model has the advantage of being able to identify when a particular person is speaking even when they are not visible to the camera (e.g. in the case of a mobile robot). Moreover, we show that a simple sensory fusion scheme between the auditory and visual models improves performance onthe task of talking detection. The work here provides dramatic evidence about the efficacy of two very different approaches to multimodal speech detection on a challenging database.