Evolutionary Systems
Self Organizing Classifiers and Niched Fitness
Vargas, Danilo Vasconcellos, Takano, Hirotaka, Murata, Junichi
Learning classifier systems are adaptive learning systems which have been widely applied in a multitude of application domains. However, there are still some generalization problems unsolved. The hurdle is that fitness and niching pressures are difficult to balance. Here, a new algorithm called Self Organizing Classifiers is proposed which faces this problem from a different perspective. Instead of balancing the pressures, both pressures are separated and no balance is necessary. In fact, the proposed algorithm possesses a dynamical population structure that self-organizes itself to better project the input space into a map. The niched fitness concept is defined along with its dynamical population structure, both are indispensable for the understanding of the proposed method. Promising results are shown on two continuous multi-step problems. One of which is yet more challenging than previous problems of this class in the literature.
Self Organizing Classifiers: First Steps in Structured Evolutionary Machine Learning
Vargas, Danilo Vasconcellos, Takano, Hirotaka, Murata, Junichi
Noname manuscript No. (will be inserted by the editor) Abstract Learning classifier systems are evolutionary machine learning algorithms, flexible enough to be applied toreinforcement, supervised and unsupervised learning problems with good performance. Recently, self organizing classifierswere proposed which are similar to learning classifier systems but have the advantage that in its structured population no balance between niching and fitness pressure is necessary. However, more tests and analysis are required to verify its benefits. Here, a variation of the first algorithm is proposed which uses a parameterless self organizing map (SOM). This algorithm isapplied in challenging problems such as big, noisy as well as dynamically changing continuous inputaction mazes(growing and compressing mazes are included) withgood performance. Moreover, a genetic operator is proposed which utilizes the topological information ofthe SOM's population structure, improving the results. Thus, the first steps in structured evolutionary machinelearning are shown, nonetheless, the problems faced are more difficult than the state-of-art continuous input-action multi-step ones. 1 Introduction Learning Classifier Systems (LCS) are several algorithms inspired by evolution [29],[20]. Different from most reinforcement learning algorithms, however, LCS algorithms do not use state-action lookup tables to predict payoff. In this manner, the difficulties that arrive from complex problems, wherea large number of states and/or actions are required, can be avoided. Oneway of solving this problem is to separate a fitness defined on a niche from fitnesses defined on other niches (i.e., having a good fitness on other niches would not influence the present niche).
Machine learning spots natural selection at work in human genome
The ability to sequence genomes quickly has provided scientists with reams of data, but understanding how evolution has shaped humans is still a difficult task.Credit: Guy Tear/Wellcome Coll./CC Pinpointing where and how the human genome is evolving can be like hunting for a needle in a haystack. Each person's genome contains three billion building blocks called nucleotides, and researchers must compile data from thousands of people to discover patterns that signal how genes have been shaped by evolutionary pressures. To find these patterns, a growing number of geneticists are turning to a form of machine learning called deep learning. Proponents of the approach say that deep-learning algorithms incorporate fewer explicit assumptions about what the genetic signatures of natural selection should look like than do conventional statistical methods.
On Human Robot Interaction using Multiple Modes
Humanoid robots have apparently similar body structure like human beings. Due to their technical design, they are sharing the same workspace with humans. They are placed to clean things, to assist old age people, to entertain us and most importantly to serve us. To be acceptable in the household, they must have higher level of intelligence than industrial robots and they must be social and capable of interacting people around it, who are not supposed to be robot specialist. All these come under the field of human robot interaction (HRI). There are various modes like speech, gesture, behavior etc. through which human can interact with robots. To solve all these challenges, a multimodel technique has been introduced where gesture as well as speech is used as a mode of interaction.
Monotonic classification: an overview on algorithms, performance measures and data sets
Cano, José-Ramón, Gutiérrez, Pedro Antonio, Krawczyk, Bartosz, Woźniak, Michał, García, Salvador
Currently, knowledge discovery in databases is an essential step to identify valid, novel and useful patterns for decision making. There are many real-world scenarios, such as bankruptcy prediction, option pricing or medical diagnosis, where the classification models to be learned need to fulfil restrictions of monotonicity (i.e. the target class label should not decrease when input attributes values increase). For instance, it is rational to assume that a higher debt ratio of a company should never result in a lower level of bankruptcy risk. Consequently, there is a growing interest from the data mining research community concerning monotonic predictive models. This paper aims to present an overview about the literature in the field, analyzing existing techniques and proposing a taxonomy of the algorithms based on the type of model generated. For each method, we review the quality metrics considered in the evaluation and the different data sets and monotonic problems used in the analysis. In this way, this paper serves as an overview of the research about monotonic classification in specialized literature and can be used as a functional guide of the field.
Optimizing Photonic Nanostructures via Multi-fidelity Gaussian Processes
Song, Jialin, Tokpanov, Yury S., Chen, Yuxin, Fleischman, Dagny, Fountaine, Kate T., Atwater, Harry A., Yue, Yisong
We apply numerical methods in combination with finite-difference-time-domain (FDTD) simulations to optimize transmission properties of plasmonic mirror color filters using a multi-objective figure of merit over a five-dimensional parameter space by utilizing novel multi-fidelity Gaussian processes approach. We compare these results with conventional derivative-free global search algorithms, such as (single-fidelity) Gaussian Processes optimization scheme, and Particle Swarm Optimization---a commonly used method in nanophotonics community, which is implemented in Lumerical commercial photonics software. We demonstrate the performance of various numerical optimization approaches on several pre-collected real-world datasets and show that by properly trading off expensive information sources with cheap simulations, one can more effectively optimize the transmission properties with a fixed budget.
Layout Design for Intelligent Warehouse by Evolution with Fitness Approximation
Zhang, Haifeng, Guo, Zilong, Cai, Han, Wang, Chris, Zhang, Weinan, Yu, Yong, Li, Wenxin, Wang, Jun
With the rapid growth of the express industry, intelligent warehouses that employ autonomous robots for carrying parcels have been widely used to handle the vast express volume. For such warehouses, the warehouse layout design plays a key role in improving the transportation efficiency. However, this work is still done by human experts, which is expensive and leads to suboptimal results. In this paper, we aim to automate the warehouse layout designing process. We propose a two-layer evolutionary algorithm to efficiently explore the warehouse layout space, where an auxiliary objective fitness approximation model is introduced to predict the outcome of the designed warehouse layout and a two-layer population structure is proposed to incorporate the approximation model into the ordinary evolution framework. Empirical experiments show that our method can efficiently design effective warehouse layouts that outperform both heuristic-designed and vanilla evolution-designed warehouse layouts.
Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning
Ooi, Rise, Yang, C. -H. Huck, Chen, Pin-Yu, Eguìluz, Vìctor, Kiani, Narsis, Zenil, Hector, Gomez-Cabrero, David, Tegnèr, Jesper
Networks are fundamental building blocks for representing data, and computations. Remarkable progress in learning in structurally defined (shallow or deep) networks has recently been achieved. Here we introduce evolutionary exploratory search and learning method of topologically flexible networks under the constraint of producing elementary computational steady-state input-output operations. Our results include; (1) the identification of networks, over four orders of magnitude, implementing computation of steady-state input-output functions, such as a band-pass filter, a threshold function, and an inverse band-pass function. Next, (2) the learned networks are technically controllable as only a small number of driver nodes are required to move the system to a new state. Furthermore, we find that the fraction of required driver nodes is constant during evolutionary learning, suggesting a stable system design. (3), our framework allows multiplexing of different computations using the same network. For example, using a binary representation of the inputs, the network can readily compute three different input-output functions. Finally, (4) the proposed evolutionary learning demonstrates transfer learning. If the system learns one function A, then learning B requires on average less number of steps as compared to learning B from tabula rasa. We conclude that the constrained evolutionary learning produces large robust controllable circuits, capable of multiplexing and transfer learning. Our study suggests that network-based computations of steady-state functions, representing either cellular modules of cell-to-cell communication networks or internal molecular circuits communicating within a cell, could be a powerful model for biologically inspired computing. This complements conceptualizations such as attractor based models, or reservoir computing.
Genetic algorithm for optimal distribution in cities
Quintero, Esteban, Sanchez, Mateo, Roldan, Nicolas, Toro, Mauricio
ABSTRACT The problem to deal with in this project is the problem of routing electric vehicles, which consists of finding the best routes for this type of vehicle, so that they reach their destination, without running out of power and optimizing to the maximum transportation costs. The importance of this problem is mainly in the sector of shipments in the recent future, when obsolete energy sources are replaced with renewable sources, where each vehicle contains a number of packages that must be delivered at specific points in the city, but, being electric, they do not have an optimal battery life, so having the ideal routes traced is a vital aspect for the proper functioning of these. Now days you can see applications of this problem in the cleaning sector, specifically with the trucks responsible for collecting garbage, which aims to travel the entire city in the most efficient way, without letting excessive garbage accumulate. PAGE SIZE All material on each page should fit within a rectangle of 18 23.5 cm (7" 9.25"), centered on the page, beginning 1.9 cm (0.75") from the top of the page and ending with 2.54 cm (1") from the bottom. The right and left margins should be 1.9 cm (.75"). The text should be in two 8.45 cm (3.33") columns with a .83
Importance Weighted Evolution Strategies
Campos, Víctor, Giro-i-Nieto, Xavier, Torres, Jordi
Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead. Despite providing large improvements in wall-clock time, ES is data inefficient when compared to competing RL methods. One of the main causes of such inefficiency is the collection of large batches of experience, which are discarded after each policy update. In this work, we study how to perform more than one update per batch of experience by means of Importance Sampling while preserving the scalability of the original method. The proposed method, Importance Weighted Evolution Strategies (IW-ES), shows promising results and is a first step towards designing efficient ES algorithms.