The ability to take intelligent actions in real-world domains is a goal of great interest in the machine learning community. Unfortunately, the real-world is filled with systems that can bepartially observed but cannot, as yet, be described by first principlemodels. Moreover, the traditional paradigm of direct interaction with the environment used in reinforcement learning (RL) is often prohibitively expensive in practice. An alternative approach that simultaneously solves both of these problems is to gain experience in simulation; the simulation in this approach is a computational model derived from observations. Advances in sensory and information technology are simplifying the acquisition and distribution of real-world datasets to computational scientists; thus, the barrier to linking intelligent control with real-world domains is becoming one of identifying high-quality state-space and transition functions directly from observations. From a dynamical systems perspective, this barrier is analogous to the problem of finding high-quality manifold embeddings and a rich literature of theory and practice exists to address it. The contribution of this work is two-fold. First, we describe an approach for learning optimal control strategies directly from observations using manifold embeddings as the intermediate state representation. Second, we demonstrate how control strategies constructed in this way can answer important scientific questions. As a concrete example, we use our approach to guide experimental decisions in neurostimulation treatments of epilepsy.

What commonsense knowledge do intelligent systems need, in order to recover from failures or deal with unexpected situations? It is impractical to represent predetermined solutions to deal with every unanticipated situation or provide predetermined fixes for all the different ways in which systems may fail. We contend that intelligent systems require only a finite set of anomaly-handling strategies to muddle through anomalous situations. We describe a generalized metacognition module that implements such a set of anomaly-handling strategies and that in principle can be attached to any host system to improve the robustness of that system. Several implemented studies are reported, that support our contention.

In this paper, we present a method for isometric correction of manifold learning techniques. We first present an isometric nonlinear dimension reduction method. Our proposed method overcomes the issues associated with well-known isometric embedding techniques such as ISOMAP and maximum variance unfolding (MVU), i.e., computational complexity and the geodesic convexity requirement. Based on the proposed algorithm, we derive our isometric correction method. Our approach follows an isometric solution to the problem of local tangent space alignment. We provide a derivation of a fast iterative solution. The performance of our algorithm is illustrated on both synthetic and real datasets compared to other methods.

The paper uses the SCOP theory of concepts to model the role of environmental context on three levels of entrepreneurial opportunity: idea generation, idea development, and entrepreneurial decision. The role of contextual-fit in the generation and development of ideas is modeled as the collapse of their superposition state into one of the potential states that composes this superposition. The projection of this collapsed state on the socio-economic basis results in interference between the developed idea and the perceptions of the supporting community, undergoing an eventual collapse for an entrepreneurial decision that reflects the shared vision of its stakeholders. The developed idea may continue to evolve due to continuous or discontinuous changes in the environment. The model offers unique insights into the effects of external influences on entrepreneurial decisions.

This article introduces a "pseudo classical" notion of modelling non-separability. This form of non-separability can be viewed as lying between separability and quantum-like non-separability. Non-separability is formalized in terms of the non-factorizabilty of the underlying joint probability distribution. A decision criterium for determining the non-factorizability of the joint distribution is related to determining the rank of a matrix as well as another approach based on the chi-square-goodness-of-fit test. This pseudo-classical notion of non-separability is discussed in terms of quantum games and concept combinations in human cognition.

This position paper provides an overview of work conducted and an outlook of future directions within the field of Information Retrieval (IR) that aims to develop novel models, methods and frameworks inspired by Quantum Theory (QT).

STRIPS-style planning has proven to be a helpful methodology for narrative generation, but certain assumptions about the process remain in use which inhibit the creation of interesting stories. The sequence of actions is more important than the initial and goal state of the world, so a narrative planner should first build a plot and then adapt the world to that plot. This is possible by relaxing the closed world assumption to allow revision to the initial and goal states.

A peloton is a group of cyclists whose individual and collective energy expenditures are reduced when cyclists ride behind others in zones of reduced air pressure; this effect is known in cycling as ‘drafting’. Through drafting cyclists couple their energy expenditures. Coupling of cyclists’ energy expenditures when drafting is the basic peloton property from which self-organized collective behaviours emerge. Here we examine peloton hysteresis, applying the definition used in the context of vehicle traffic in which a rapid deceleration to a high density state (jam) is followed by a lag in vehicle acceleration. Applying a flow analysis of volume (number of cyclists) over time, peloton hysteresis is examined in three forms: one is similar to vehicle traffic hysteresis in which rapid decelerations and increased flow (or density) are followed by extended acceleration periods and reduced flow. In cycling this is known as the accordion effect. A second kind of hysteresis results from rapid accelerations followed by periods of decreasing speeds and decreasing flow. This form of hysteresis is essentially inverse to traffic hysteresis and the accordion effect. We show this form of hysteresis using data from a mass-start bicycle points-race. A third kind of peloton hysteresis occurs when the drafting benefit is minimized on hills and weaker cyclists lose positions in the peloton, while flow/density is retained. A computer simulation shows this hysteresis among two sets of cyclist agents, each with different output capacity and models hysteresis as a peloton transitions from flat topography to a steep incline on which drafting is negligible.

Studying how a robot can learn to communicate with a person provides insight into how communication might be learned in general. Deep models of dialog and communicative intent typically rely on modeling the internal state of the speakers—states that are unobservable by a learning robot. This paper considers how communication can be framed to be learnable from experience. In particular, we describe how an agent might learn to communicate by building on three foundational capabilities, namely 1) an observable signal of satisfied intent (a smile), 2) the ability to imitate perceived actions, and 3) perceptual referents for discourse items. Early simulation results show that an agent can learn some basic communication skills from these foundations.

Future service robots applications in healthcare may require systems to be adaptable in terms of verbal and non-verbal behaviors to ensure patient perceptions of quality healthcare. Adaptation of robot behaviors should account for patient emotional states. Related to this, there is a need for a reliable method by which to classify patient emotions in real-time during patient-robot interaction (PRI). Accurate emotion classification could facilitate appropriate robot adaptation and effective healthcare operations (e.g., medicine delivery). We conducted and compared two simulated robot medicine delivery experiments with different participant age groups and robot configurations. A meta-analysis of the data from these experiments was to identify a robust approach for emotional state classification across age groups and robot configurations. Results revealed age differences as well as multiple robot humanoid feature manipulations to cause inaccuracy in emotion classification using statistical and machine learning methods. Younger adults tend to have higher emotional variability than elderly. Combinations of robot features were also found to induce emotional uncertainty and extreme responses. These findings were largely reflected in terms of physiological responses rather than subjective reports of emotions.