Optimization
Fairness in generative modeling
Zameshina, Mariia, Teytaud, Olivier, Teytaud, Fabien, Hosu, Vlad, Carraz, Nathanael, Najman, Laurent, Wagner, Markus
We design general-purpose algorithms for addressing fairness issues There are many facets to fairness. An algorithm may be considered and mode collapse in generative modeling. More precisely, to design to be fair if its results are independent of some variables, particularly fair algorithms for as many sensitive variables as possible, including for sensitive variables. Fairness [18] can be measured in terms of variables we might not be aware of, we assume no prior knowledge separation, i.e., whether the probability of a given prediction, given of sensitive variables: our algorithms use unsupervised fairness the actual value, is the same for all values of a sensitive variable.
Active Localization using Bernstein Distribution Functions
Tabasso, Camilla, Cichella, Venanzio
In this work, we present a framework that enables a vehicle to autonomously localize a target based on noisy range measurements computed from RSSI data. To achieve the mission objectives, we develop a control scheme composed of two main parts: an estimator and a motion planner. At each time step, new estimates of the target's position are computed and used to generate and update distribution functions using Bernstein polynomials. A metric of the efficiency of the estimator is derived based on the Fisher Information Matrix. Finally, the motion planning problem is formulated to react in real time to new information about the target and improve the estimator's performance.
Meta Reinforcement Learning for Optimal Design of Legged Robots
Belmonte-Baeza, Álvaro, Lee, Joonho, Valsecchi, Giorgio, Hutter, Marco
The process of robot design is a complex task and the majority of design decisions are still based on human intuition or tedious manual tuning. A more informed way of facing this task is computational design methods where design parameters are concurrently optimized with corresponding controllers. Existing approaches, however, are strongly influenced by predefined control rules or motion templates and cannot provide end-to-end solutions. In this paper, we present a design optimization framework using model-free meta reinforcement learning, and its application to the optimizing kinematics and actuator parameters of quadrupedal robots. We use meta reinforcement learning to train a locomotion policy that can quickly adapt to different designs. This policy is used to evaluate each design instance during the design optimization. We demonstrate that the policy can control robots of different designs to track random velocity commands over various rough terrains. With controlled experiments, we show that the meta policy achieves close-to-optimal performance for each design instance after adaptation. Lastly, we compare our results against a model-based baseline and show that our approach allows higher performance while not being constrained by predefined motions or gait patterns.
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO
Eggensperger, Katharina, Müller, Philipp, Mallik, Neeratyoy, Feurer, Matthias, Sass, René, Klein, Aaron, Awad, Noor, Lindauer, Marius, Hutter, Frank
To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial component of machine learning and its applications. Over the last years, the number of efficient algorithms and tools for HPO grew substantially. At the same time, the community is still lacking realistic, diverse, computationally cheap, and standardized benchmarks. This is especially the case for multi-fidelity HPO methods. To close this gap, we propose HPOBench, which includes 7 existing and 5 new benchmark families, with a total of more than 100 multi-fidelity benchmark problems. HPOBench allows to run this extendable set of multi-fidelity HPO benchmarks in a reproducible way by isolating and packaging the individual benchmarks in containers. It also provides surrogate and tabular benchmarks for computationally affordable yet statistically sound evaluations. To demonstrate HPOBench's broad compatibility with various optimization tools, as well as its usefulness, we conduct an exemplary large-scale study evaluating 13 optimizers from 6 optimization tools. We provide HPOBench here: https://github.com/automl/HPOBench.
A General Recipe for Likelihood-free Bayesian Optimization
Song, Jiaming, Yu, Lantao, Neiswanger, Willie, Ermon, Stefano
The acquisition function, a critical component in Bayesian optimization (BO), can often be written as the expectation of a utility function under a surrogate model. However, to ensure that acquisition functions are tractable to optimize, restrictions must be placed on the surrogate model and utility function. To extend BO to a broader class of models and utilities, we propose likelihood-free BO (LFBO), an approach based on likelihood-free inference. LFBO directly models the acquisition function without having to separately perform inference with a probabilistic surrogate model. We show that computing the acquisition function in LFBO can be reduced to optimizing a weighted classification problem, where the weights correspond to the utility being chosen. By choosing the utility function for expected improvement (EI), LFBO outperforms various state-of-the-art black-box optimization methods on several real-world optimization problems. LFBO can also effectively leverage composite structures of the objective function, which further improves its regret by several orders of magnitude.
General Univariate Estimation-of-Distribution Algorithms
We propose a general formulation of a univariate estimation-of-distribution algorithm (EDA). It naturally incorporates the three classic univariate EDAs \emph{compact genetic algorithm}, \emph{univariate marginal distribution algorithm} and \emph{population-based incremental learning} as well as the \emph{max-min ant system} with iteration-best update. Our unified description of the existing algorithms allows a unified analysis of these; we demonstrate this by providing an analysis of genetic drift that immediately gives the existing results proven separately for the four algorithms named above. Our general model also includes EDAs that are more efficient than the existing ones and these may not be difficult to find as we demonstrate for the OneMax and LeadingOnes benchmarks.
Cooperative Coverage with a Leader and a Wingmate in Communication-Constrained Environments
Hari, Sai Krishna Kanth, Rathinam, Sivakumar, Darbha, Swaroop, Casbeer, David W.
We consider a mission framework in which two unmanned vehicles (UVs), a leader and a wingmate, are required to provide cooperative coverage of an environment while being within a short communication range. This framework finds applications in underwater and/or military domains, where certain constraints are imposed on communication by either the application or the environment. An important objective of missions within this framework is to minimize the total travel and communication costs of the leader-wingmate duo. In this paper, we propose and formulate the problem of finding routes for the UVs that minimize the sum of their travel and communication costs as a network optimization problem of the form of a binary program (BP). The BP is computationally expensive, with the time required to compute optimal solutions increasing rapidly with the problem size. To address this challenge, here, we propose two algorithms, an approximation algorithm and a heuristic algorithm, to solve large-scale instances of the problem swiftly. We demonstrate the effectiveness and the scalability of these algorithms through an analysis of extensive numerical simulations performed over 500 instances, with the number of targets in the instances ranging from 6 to 100.
Astrobotics: Swarm Robotics for Astrophysical Studies
Macktoobian, Matin, Gillet, Denis, Kneib, Jean-Paul
Published in "IEEE Robotics and Automation Magazine", DOI: 10.1109/MRA.2020.3044911 Matin Macktoobian, Denis Gillet, and Jean-Paul Kneib The authors are with the School of Engineering, Swiss Federal Institute of Technology in Lausanne (EPFL), Lausanne, Switzerland (e-mail: matin.macktoobian@epfl.ch; Abstract This paper introduces the emerging field of astrobotics, that is, a recently-established branch of robotics to be of service to astrophysics and observational astronomy. We first describe a modern requirement of dark matter studies, i.e., the generation of the map of the observable universe, using astrobots. Astrobots differ from conventional two-degree-of-freedom robotic manipulators in two respects. First, the dense formation of astrobots give rise to the extremely overlapping dynamics of neighboring astrobots which make them severely subject to collisions. Second, the structure of astrobots and their mechanical specifications are specialized due to the embedded optical fibers passed through them. We focus on the coordination problem of astrobots whose solutions shall be collision-free, fast execution, and complete in terms of the astrobots' convergence rates. We also illustrate the significant impact of astrobots assignments to observational targets on the quality of coordination solutions To present the current state of the field, we elaborate the open problems including next-generation astrophysical projects including 20,000 astrobots, and other fields, such as space debris tracking, in which astrobots may be potentially used. Astrobotics is an emerging field of swarm robotics aiming to the development and control of astrobots [1, 2] to be of service to astrophysical studies and cosmological spectroscopic observations. In particular, astrobotics addresses a wide range of swarm-robotic-related topics (see, Figure 1) which exhibit challenging problems in design, interaction, coordination, and mission planning corresponding to astrobots. There have been many astrophysical projects, such as the SDSS family [3] which seek the generation of the map of the observable universe.
ProxNLP: a primal-dual augmented Lagrangian solver for nonlinear programming in Robotics and beyond
Jallet, Wilson, Bambade, Antoine, Mansard, Nicolas, Carpentier, Justin
Mathematical optimization is the workhorse behind several aspects of modern robotics and control. In these applications, the focus is on constrained optimization, and the ability to work on manifolds (such as the classical matrix Lie groups), along with a specific requirement for robustness and speed. In recent years, augmented Lagrangian methods have seen a resurgence due to their robustness and flexibility, their connections to (inexact) proximal-point methods, and their interoperability with Newton or semismooth Newton methods. In the sequel, we present primal-dual augmented Lagrangian method for inequality-constrained problems on manifolds, which we introduced in our recent work, as well as an efficient C++ implementation suitable for use in robotics applications and beyond.
On Parallel or Distributed Asynchronous Iterations with Unbounded Delays and Possible Out of Order Messages or Flexible Communication for Convex Optimization Problems and Machine Learning
We describe several features of parallel or distributed asynchronous iterative algorithms such as unbounded delays, possible out of order messages or flexible communication. We concentrate on the concept of macroiteration sequence which was introduced in order to study the convergence or termination of asynchronous iterations. A survey of asynchronous iterations for convex optimization problems is also presented. Finally, a new result of convergence for parallel or distributed asynchronous iterative algorithms with flexible communication for convex optimization problems and machine learning is proposed.