Evolutionary Systems
Swarm Intelligence and Weak Artificial Creativity
al-Rifaie, Mohammad Majid (Vividus Solutions LTD.) | Bishop, John Mark (Goldsmiths College, University of London)
Swarm intelligence via its infamous struggle to identify a suitable balance between exploration and exploitation phases, provides a valuable mean to approach artificial creativity. This work deploys two swarm intelligence algorithms, one simulating the behaviour of birds flocking and fish schooling (Particle Swarm Optimisation) and the other mimicking the behaviour of ants foraging (Stochastic Diffusion Search) in order to lay the foundation for a discussion addressing the concepts of freedom and constraint within the topic of creativity in general, and more specifically their impact on the artificial creativity of the underlying systems. An analogy is drawn on mapping these two `prerequisites' of creativity onto the two well-known aforementioned phases of exploration and exploitation in swarm intelligence algorithms. This is accompanied by the visualisation of the behaviour of the swarms whose performance are evaluated in the context of the arguments presented. Additionally in the spirit of Searle's definition of weak and strong artificial intelligence, a discussion on weak vs. strong artificial creativity in swarm intelligence systems is presented.
Hedge Detection Using a Rewards and Penalties Approach
Stahl, Ken (State University of New York - University at Albany) | Shaikh, Samira (State University of New York - University at Albany) | Strzalkowski, Tomek (State University of New York - University at Albany)
Semantic and syntactic features found in text can be used in combination to statistically predict linguistic devices such as hedges in online chat. Some features are better indicators than others, and there are cases when multiple features need to be considered together to be useful. Once the features are identified, it becomes an optimization problem to find the best division of data. We have devised a genetic algorithm approach towards detecting hedges in online multi-party chat discourse. A system was created using rewards and penalties for matching features in tokenized text, so optimizing the reward and penalty amounts are the main challenge. Genetic algorithms, a subset of Evolutionary Algorithms, are great for optimization; as they are massively parallel directed searches, and therefore suited to finding the best ratio of integer rewards and penalties. “Evolutionary algorithms (EAs) utilize principles of natural selection and are robust adaptive search schemes suitable for searching nonlinear, discontinuous, and high-dimensional spaces. This class of algorithms is being increasingly applied to obtain optimal or near-optimal solutions to many complex real-world optimization problems” (Bonissone, et. al. 2006) We show results using 10-fold cross validation as commonly used in traditional machine learning. The best performance without further fine tuning is 79% in classifying whether an utterance in chat contains a hedge or not.
Generating extrema approximation of analytically incomputable functions through usage of parallel computer aided genetic algorithms
Genetic algorithm (GA) is a type of algorithm inspired by the evolution of living organisms in the nature. It belongs to evolution algorithms whose idea was started by John Henry Holland, the American engineer and scientist. GA in a specific way searches in the area of solutions of a problem to find the best solution. The algorithm defines environment in which a specific population of specimens being possible solutions of the problem exists. Next, similarly to organisms in the nature, the specimens are crossbred, mutated and selection of the best solutions based on the value of adaptation function occurs. Ideas of genetic algorithm were presented in Figure 1. Figure 1.
Complexity distribution of agent policies
We analyse the complexity of environments according to the policies that need to be used to achieve high performance. The performance results for a population of policies leads to a distribution that is examined in terms of policy complexity and analysed through several diagrams and indicators. The notion of environment response curve is also introduced, by inverting the performance results into an ability scale. We apply all these concepts, diagrams and indicators to a minimalistic environment class, agent-populated elementary cellular automata, showing how the difficulty, discriminating power and ranges (previous to normalisation) may vary for several environments.
Generating Motion Patterns Using Evolutionary Computation in Digital Soccer
Amoozgar, Masoud, Khashabi, Daniel, Heydarian, Milad, Nokhbeh, Mohammad, Shouraki, Saeed Bagheri
Dribbling an opponent player in digital soccer environment is an important practical problem in motion planning. It has special complexities which can be generalized to most important problems in other similar Multi Agent Systems. In this paper, we propose a hybrid computational geometry and evolutionary computation approach for generating motion trajectories to avoid a mobile obstacle. In this case an opponent agent is not only an obstacle but also one who tries to harden dribbling procedure. One characteristic of this approach is reducing process cost of online stage by transferring it to offline stage which causes increment in agents' performance. This approach breaks the problem into two offline and online stages. During offline stage the goal is to find desired trajectory using evolutionary computation and saving it as a trajectory plan. A trajectory plan consists of nodes which approximate information of each trajectory plan. In online stage, a linear interpolation along with Delaunay triangulation in xy-plan is applied to trajectory plan to retrieve desired action.
A Frequency-Domain Encoding for Neuroevolution
Koutník, Jan, Schmidhuber, Juergen, Gomez, Faustino
Neuroevolution has yet to scale up to complex reinforcement learning tasks that require large networks. Networks with many inputs (e.g. raw video) imply a very high dimensional search space if encoded directly. Indirect methods use a more compact genotype representation that is transformed into networks of potentially arbitrary size. In this paper, we present an indirect method where networks are encoded by a set of Fourier coefficients which are transformed into network weight matrices via an inverse Fourier-type transform. Because there often exist network solutions whose weight matrices contain regularity (i.e. adjacent weights are correlated), the number of coefficients required to represent these networks in the frequency domain is much smaller than the number of weights (in the same way that natural images can be compressed by ignore high-frequency components). This "compressed" encoding is compared to the direct approach where search is conducted in the weight space on the high-dimensional octopus arm task. The results show that representing networks in the frequency domain can reduce the search-space dimensionality by as much as two orders of magnitude, both accelerating convergence and yielding more general solutions.
Multi-Objective AI Planning: Evaluating DAE-YAHSP on a Tunable Benchmark
Khouadjia, Mostepha Redouane, Schoenauer, Marc, Vidal, Vincent, Dréo, Johann, Savéant, Pierre
All standard AI planners to-date can only handle a single objective, and the only way for them to take into account multiple objectives is by aggregation of the objectives. Furthermore, and in deep contrast with the single objective case, there exists no benchmark problems on which to test the algorithms for multi-objective planning. Divide and Evolve (DAE) is an evolutionary planner that won the (single-objective) deterministic temporal satisficing track in the last International Planning Competition. Even though it uses intensively the classical (and hence single-objective) planner YAHSP, it is possible to turn DAE-YAHSP into a multi-objective evolutionary planner. A tunable benchmark suite for multi-objective planning is first proposed, and the performances of several variants of multi-objective DAE-YAHSP are compared on different instances of this benchmark, hopefully paving the road to further multi-objective competitions in AI planning.
Towards the Evolution of Novel Vertical-Axis Wind Turbines
Preen, Richard J., Bull, Larry
Renewable and sustainable energy is one of the most important challenges currently facing mankind. Wind has made an increasing contribution to the world's energy supply mix, but still remains a long way from reaching its full potential. In this paper, we investigate the use of artificial evolution to design vertical-axis wind turbine prototypes that are physically instantiated and evaluated under approximated wind tunnel conditions. An artificial neural network is used as a surrogate model to assist learning and found to reduce the number of fabrications required to reach a higher aerodynamic efficiency, resulting in an important cost reduction. Unlike in other approaches, such as computational fluid dynamics simulations, no mathematical formulations are used and no model assumptions are made. Index Terms Evolutionary algorithms, surrogate assisted evolution, three-dimensional printers, wind turbines. In recent years, wind has made an increasing contribution to the world's energy supply mix.
Online Learning for Ground Trajectory Prediction
Hadjaz, Areski, Marceau, Gaétan, Savéant, Pierre, Schoenauer, Marc
This paper presents a model based on an hybrid system to numerically simulate the climbing phase of an aircraft. This model is then used within a trajectory prediction tool. Finally, the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) optimization algorithm is used to tune five selected parameters, and thus improve the accuracy of the model. Incorporated within a trajectory prediction tool, this model can be used to derive the order of magnitude of the prediction error over time, and thus the domain of validity of the trajectory prediction. A first validation experiment of the proposed model is based on the errors along time for a one-time trajectory prediction at the take off of the flight with respect to the default values of the theoretical BADA model. This experiment, assuming complete information, also shows the limit of the model. A second experiment part presents an on-line trajectory prediction, in which the prediction is continuously updated based on the current aircraft position. This approach raises several issues, for which improvements of the basic model are proposed, and the resulting trajectory prediction tool shows statistically significantly more accurate results than those of the default model.
Speed Optimization In Unplanned Traffic Using Bio-Inspired Computing And Population Knowledge Base
Ghosal, Prasun, Chakraborty, Arijit, Banerjee, Sabyasachee, Barman, Satabdi
Bio-Inspired Algorithms on Road Traffic Congestion and safety is a very promising research problem. Searching for an efficient optimization method to increase the degree of speed optimization and thereby increasing the traffic Flow in an unplanned zone is a widely concerning issue. However, there has been a limited research effort on the optimization of the lane usage with speed optimization. The main objective of this article is to find avenues or techniques in a novel way to solve the problem optimally using the knowledge from analysis of speeds of vehicles, which, in turn will act as a guide for design of lanes optimally to provide better optimized traffic. The accident factors adjust the base model estimates for individual geometric design element dimensions and for traffic control features. The application of these algorithms in partially modified form in accordance of this novel Speed Optimization Technique in an Unplanned Traffic analysis technique is applied to the proposed design and speed optimization plan. The experimental results based on real life data are quite encouraging.