The new scenarios of contemporary adaptive robotics seem to suggest a transformation of the traditional methods. In the search for new approaches to the control of adaptive autonomous systems, the mind becomes a fundamental source of inspiration. In this paper we anticipate, through the use of simulation, the cognitive and behavioral properties that emerge from a recent prototype robotic platform, EcoBot, a family of bio-mechatronic symbionts provided with an `artificial metabolism', that has been under physical development during recent years. Its energy reliance on a biological component and the consequent limitation of its supplied energy determine a special kind of dynamic coupling between the robot and its environment. Rather than just an obstacle, energetic constraints become the opportunity for the development of a rich set of behavioral and cognitive properties.

This research aims to define a novel framework to employ engineering and mathematical models to study adaptive dynamics in heterarchial systems. This multi-profile descriptive platform and modeling approach is developed as a composite of conceptual behaviors and structural entity aspects of engineered complex adaptive systems (ECAS). While the US electric power system will be utilized for demonstration and validation, the framework has applicability to the general class of ECASs that are artificially created but highly interactive with natural and behavioral sciences. Conditioned on parameterization of the framework, a theorem will be presented to calibrate current structure and predict future dynamic behaviors of an ECAS. We analyze decentralized heterarchial ECASs to infer emergent behavior of the components, and evolution processes and adaptations of the whole system.

Broadly speaking, information has something to do with order or organization within a system of elements. The thermodynamic concept of entropy is also associated with such systems, although in an inverse relationship. When we attempt to put these two apparently coordinated schemas of order and disorder together, all kinds of difficulties arise. I will briefly examine contemporary efforts to unify these two ways of conceiving order and show that they are substantially incompatible. In this process I will draw some distinctions that will lead to a broader reconciliation of the concepts of order and information. I will then attempt to re-evaluate the fundamental models behind these dissonant traditions for formulating order in an attempt to reframe a synthesis of conceptual structures that are mutually reconcilable. I will try to show that such a synthesis can finally make sense of the stubborn inconsistencies that persist in the ways Newtonian dynamics, thermodynamics and biology utilize the implicitly conflicting arrows of time.

Inference techniques play a central role in many cognitive systems. They transform low-level observations of the environment into high-level, actionable knowledge which then gets used by mechanisms that drive action, problem-solving, and learning. This paper presents an initial effort at combining results from AI and psychology into a pragmatic and scalable computational reasoning system. Our approach combines a numeric notion of plausibility with first-order logic to produce an incremental inference engine that is guided by heuristics derived from the psychological literature. We illustrate core ideas with detailed examples and discuss the advantages of the approach with respect to cognitive systems.

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially costly objective function evaluations. We demonstrate the strategy in the complex setting of sampling from constrained, discrete and densely connected probabilistic graphical models where, for each variation of the problem, one needs to adjust the parameters of the proposal mechanism automatically to ensure efficient mixing of the Markov chains.

One of the important issues in computer networks is "Load Balancing" which leads to efficient use of the network resources. To achieve a balanced network it is necessary to find different routes between the source and destination. In the current paper we propose a new approach to find different routes using swarm intelligence techniques and multi colony algorithms. In the proposed algorithm that is an improved version of MACO algorithm, we use different colonies of ants and bees and appoint these colony members as intelligent agents to monitor the network and update the routing information. The survey includes comparison and critiques of MACO. The simulation results show a tangible improvement in the aforementioned approach.

We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates input dependent signal and noise correlations between multiple response variables, input dependent length-scales and amplitudes, and heavy-tailed predictive distributions. We derive both efficient Markov chain Monte Carlo and variational Bayes inference procedures for this model. We apply GPRN as a multiple output regression and multivariate volatility model, demonstrating substantially improved performance over eight popular multiple output (multi-task) Gaussian process models and three multivariate volatility models on benchmark datasets, including a 1000 dimensional gene expression dataset.

The exploration-exploitation trade-off is among the central challenges of reinforcement learning. The optimal Bayesian solution is intractable in general. This paper studies to what extent analytic statements about optimal learning are possible if all beliefs are Gaussian processes. A first order approximation of learning of both loss and dynamics, for nonlinear, time-varying systems in continuous time and space, subject to a relatively weak restriction on the dynamics, is described by an infinite-dimensional partial differential equation. An approximate finite-dimensional projection gives an impression for how this result may be helpful.

Numerous formalisms and dedicated algorithms have been designed in the last decades to model and solve decision making problems. Some formalisms, such as constraint networks, can express "simple" decision problems, while others are designed to take into account uncertainties, unfeasible decisions, and utilities. Even in a single formalism, several variants are often proposed to model different types of uncertainty (probability, possibility...) or utility (additive or not). In this article, we introduce an algebraic graphical model that encompasses a large number of such formalisms: (1) we first adapt previous structures from Friedman, Chu and Halpern for representing uncertainty, utility, and expected utility in order to deal with generic forms of sequential decision making; (2) on these structures, we then introduce composite graphical models that express information via variables linked by "local" functions, thanks to conditional independence; (3) on these graphical models, we finally define a simple class of queries which can represent various scenarios in terms of observabilities and controllabilities. A natural decision-tree semantics for such queries is completed by an equivalent operational semantics, which induces generic algorithms. The proposed framework, called the Plausibility-Feasibility-Utility (PFU) framework, not only provides a better understanding of the links between existing formalisms, but it also covers yet unpublished frameworks (such as possibilistic influence diagrams) and unifies formalisms such as quantified boolean formulas and influence diagrams. Our backtrack and variable elimination generic algorithms are a first step towards unified algorithms.

We study the performance of different message passing algorithms in the two dimensional Edwards Anderson model. We show that the standard Belief Propagation (BP) algorithm converges only at high temperature to a paramagnetic solution. Then, we test a Generalized Belief Propagation (GBP) algorithm, derived from a Cluster Variational Method (CVM) at the plaquette level. We compare its performance with BP and with other algorithms derived under the same approximation: Double Loop (DL) and a two-ways message passing algorithm (HAK). The plaquette-CVM approximation improves BP in at least three ways: the quality of the paramagnetic solution at high temperatures, a better estimate (lower) for the critical temperature, and the fact that the GBP message passing algorithm converges also to non paramagnetic solutions. The lack of convergence of the standard GBP message passing algorithm at low temperatures seems to be related to the implementation details and not to the appearance of long range order. In fact, we prove that a gauge invariance of the constrained CVM free energy can be exploited to derive a new message passing algorithm which converges at even lower temperatures. In all its region of convergence this new algorithm is faster than HAK and DL by some orders of magnitude.