Goto

Collaborating Authors

 Europe


Artificial Hormone Reaction Networks: Towards Higher Evolvability in Evolutionary Multi-Modular Robotics

arXiv.org Artificial Intelligence

The semi-automatic or automatic synthesis of robot controller software is both desirable and challenging. Synthesis of rather simple behaviors such as collision avoidance by applying artificial evolution has been shown multiple times. However, the difficulty of this synthesis increases heavily with increasing complexity of the task that should be performed by the robot. We try to tackle this problem of complexity with Artificial Homeostatic Hormone Systems (AHHS), which provide both intrinsic, homeostatic processes and (transient) intrinsic, variant behavior. By using AHHS the need for pre-defined controller topologies or information about the field of application is minimized. We investigate how the principle design of the controller and the hormone network size affects the overall performance of the artificial evolution (i.e., evolvability). This is done by comparing two variants of AHHS that show different effects when mutated. We evolve a controller for a robot built from five autonomous, cooperating modules. The desired behavior is a form of gait resulting in fast locomotion by using the modules' main hinges.


Characterization of differentially expressed genes using high-dimensional co-expression networks

arXiv.org Machine Learning

We present a technique to characterize differentially expressed genes in terms of their position in a high-dimensional co-expression network. The set-up of Gaussian graphical models is used to construct representations of the co-expression network in such a way that redundancy and the propagation of spurious information along the network are avoided. The proposed inference procedure is based on the minimization of the Bayesian Information Criterion (BIC) in the class of decomposable graphical models. This class of models can be used to represent complex relationships and has suitable properties that allow to make effective inference in problems with high degree of complexity (e.g. several thousands of genes) and small number of observations (e.g. 10-100) as typically occurs in high throughput gene expression studies. Taking advantage of the internal structure of decomposable graphical models, we construct a compact representation of the co-expression network that allows to identify the regions with high concentration of differentially expressed genes. It is argued that differentially expressed genes located in highly interconnected regions of the co-expression network are less informative than differentially expressed genes located in less interconnected regions. Based on that idea, a measure of uncertainty that resembles the notion of relative entropy is proposed. Our methods are illustrated with three publically available data sets on microarray experiments (the larger involving more than 50,000 genes and 64 patients) and a short simulation study.


Convex Analysis and Optimization with Submodular Functions: a Tutorial

arXiv.org Machine Learning

Set-functions appear in many areas of computer science and applied mathematics, such as machine learning, computer vision, operations research or electrical networks. Among these set-functions, submodular functions play an important role, similar to convex functions on vector spaces. In this tutorial, the theory of submodular functions is presented, in a self-contained way, with all results shown from first principles. A good knowledge of convex analysis is assumed.


Structured sparsity-inducing norms through submodular functions

arXiv.org Machine Learning

Sparse methods for supervised learning aim at finding good linear predictors from as few variables as possible, i.e., with small cardinality of their supports. This combinatorial selection problem is often turned into a convex optimization problem by replacing the cardinality function by its convex envelope (tightest convex lower bound), in this case the L1-norm. In this paper, we investigate more general set-functions than the cardinality, that may incorporate prior knowledge or structural constraints which are common in many applications: namely, we show that for nondecreasing submodular set-functions, the corresponding convex envelope can be obtained from its \lova extension, a common tool in submodular analysis. This defines a family of polyhedral norms, for which we provide generic algorithmic tools (subgradients and proximal operators) and theoretical results (conditions for support recovery or high-dimensional inference). By selecting specific submodular functions, we can give a new interpretation to known norms, such as those based on rank-statistics or grouped norms with potentially overlapping groups; we also define new norms, in particular ones that can be used as non-factorial priors for supervised learning.


Exact block-wise optimization in group lasso and sparse group lasso for linear regression

arXiv.org Machine Learning

The group lasso is a penalized regression method, used in regression problems where the covariates are partitioned into groups to promote sparsity at the group level. Existing methods for finding the group lasso estimator either use gradient projection methods to update the entire coefficient vector simultaneously at each step, or update one group of coefficients at a time using an inexact line search to approximate the optimal value for the group of coefficients when all other groups' coefficients are fixed. We present a new method of computation for the group lasso in the linear regression case, the Single Line Search (SLS) algorithm, which operates by computing the exact optimal value for each group (when all other coefficients are fixed) with one univariate line search. We perform simulations demonstrating that the SLS algorithm is often more efficient than existing computational methods. We also extend the SLS algorithm to the sparse group lasso problem via the Signed Single Line Search (SSLS) algorithm, and give theoretical results to support both algorithms.


Efficient Bayesian Inference for Generalized Bradley-Terry Models

arXiv.org Machine Learning

The Bradley-Terry model is a popular approach to describe probabilities of the possible outcomes when elements of a set are repeatedly compared with one another in pairs. It has found many applications including animal behaviour, chess ranking and multiclass classification. Numerous extensions of the basic model have also been proposed in the literature including models with ties, multiple comparisons, group comparisons and random graphs. From a computational point of view, Hunter (2004) has proposed efficient iterative MM (minorization-maximization) algorithms to perform maximum likelihood estimation for these generalized Bradley-Terry models whereas Bayesian inference is typically performed using MCMC (Markov chain Monte Carlo) algorithms based on tailored Metropolis-Hastings (M-H) proposals. We show here that these MM\ algorithms can be reinterpreted as special instances of Expectation-Maximization (EM) algorithms associated to suitable sets of latent variables and propose some original extensions. These latent variables allow us to derive simple Gibbs samplers for Bayesian inference. We demonstrate experimentally the efficiency of these algorithms on a variety of applications.


Persuasive Stories for Multi-Agent Argumentation

AAAI Conferences

In this paper, we explore ideas regarding a formal logical model which allows for the use of stories to persuade autonomous software agents to take a particular course of action. This model will show how typical stories – sequences of events that form a meaningful whole – can be used to set an example for an agent and how the agent might adapt his own values and choices according to the values and choices made by the characters in the story.


Comparing Formal Frameworks of Narrative Structure

AAAI Conferences

Lehnert's Plot Units (Lehnert 1981) or Rumelhart's Story Grammars (Rumelhart 1980), and naturally, one would like We give semiformal We aim at capturing the informal human notion of equivalence definitions in § 2 and then give a few examples (without any of stories in a formal system in such a way that formal details) in § 3. two stories are perceived as equivalent when their formal representations are isomorphic (cf. There is no unique "human Comparing the adequacy of frameworks is not a formal task, notion of equivalence of stories" as the research on analogical but deals with the degree of representation of the informal reasoning shows (Rattermann and Gentner 1987; notions in the formal setting.


Preface: Meta-Cognitive Educational Systems: One Step Forward

AAAI Conferences

The AAAI Fall Symposium on Meta-Cognitive Educational - What are the theoretical foundations and how are they articulated Systems: One Step Forward is the second edition of the successful in CBLEs? MCES implemented as CBLEs are designed to interact with - What are the main aspects of metacognition, selfregulation users, and support their learning and decision-making processes. Can MCES actually foster they need to plan their learning activities, to adapt their learners to be self-regulating agents? How can a MCES learning strategies to meet learning goals, become aware of be autonomous and increase its knowledge to match the changing task conditions, and the dynamic aspects of the learners evolving skills and knowledge? MCES may not be embodied, prior to, during, and after they have been involved in but does it help if they act as intentional agents? the learning environment.


Story Schemes for Argumentation about the Facts of a Crime

AAAI Conferences

In the literature on reasoning on the basis of evidence, two traditions exist: one argument-based, and one based on narratives. Recently, we have proposed a hybrid perspective in which argumentation and narratives are combined. This formalized hybrid theory has been tested in a sense-making software prototype for criminal investigators and decision makers. In the present paper, we elaborate on the role of commonsense knowledge. We argue that two kinds of knowledge are essential: argumentation schemes and story schemes. We discuss some of the research issues that need to be addressed.