Evolutionary Systems
How Tycoons Created the Dinosaur - Issue 107: The Edge
The dinosaur is a chimera. Some parts of this complex assemblage are the result of biological evolution. But others are products of human ingenuity, constructed by artists, scientists, and technicians in a laborious process that stretches from the dig site to the naturalist's study and the museum's preparation lab. The mounted skeletons that have become such a staple of natural history museums most closely resemble mixed media sculptures, having been cobbled together from a large number of disparate elements that include plaster, steel, and paint, in addition to fossilized bone. When standing before one of these towering creatures, such as the T. rex skeleton named Sue in Chicago's Field Museum of Natural History, it is surprisingly difficult to distinguish which features are ancient and which ones are modern, where prehistory ends and imagination begins. If dinosaurs in museums are chimeras, their prehistoric antecedents are unobservable entities. In this respect, dinosaurs resemble subatomic particles like electrons, neutrons, and positrons. Both are inaccessible to direct observation, but for different reasons.
EvoGAN: An Evolutionary Computation Assisted GAN
Liu, Feng, Wang, HanYang, Zhang, Jiahao, Fu, Ziwang, Zhou, Aimin, Qi, Jiayin, Li, Zhibin
The image synthesis technique is relatively well established which can generate facial images that are indistinguishable even by human beings. However, all of these approaches uses gradients to condition the output, resulting in the outputting the same image with the same input. Also, they can only generate images with basic expression or mimic an expression instead of generating compound expression. In real life, however, human expressions are of great diversity and complexity. In this paper, we propose an evolutionary algorithm (EA) assisted GAN, named EvoGAN, to generate various compound expressions with any accurate target compound expression. EvoGAN uses an EA to search target results in the data distribution learned by GAN. Specifically, we use the Facial Action Coding System (FACS) as the encoding of an EA and use a pre-trained GAN to generate human facial images, and then use a pre-trained classifier to recognize the expression composition of the synthesized images as the fitness function to guide the search of the EA. Combined random searching algorithm, various images with the target expression can be easily sythesized. Quantitative and Qualitative results are presented on several compound expressions, and the experimental results demonstrate the feasibility and the potential of EvoGAN.
GCNScheduler: Scheduling Distributed Computing Applications using Graph Convolutional Networks
Kiamari, Mehrdad, Krishnamachari, Bhaskar
We consider the classical problem of scheduling task graphs corresponding to complex applications on distributed computing systems. A number of heuristics have been previously proposed to optimize task scheduling with respect to metrics such as makespan and throughput. However, they tend to be slow to run, particularly for larger problem instances, limiting their applicability in more dynamic systems. Motivated by the goal of solving these problems more rapidly, we propose, for the first time, a graph convolutional network-based scheduler (GCNScheduler). By carefully integrating an inter-task data dependency structure with network settings into an input graph and feeding it to an appropriate GCN, the GCNScheduler can efficiently schedule tasks of complex applications for a given objective. We evaluate our scheme with baselines through simulations. We show that not only can our scheme quickly and efficiently learn from existing scheduling schemes, but also it can easily be applied to large-scale settings where current scheduling schemes fail to handle. We show that it achieves better makespan than the classic HEFT algorithm, and almost the same throughput as throughput-oriented HEFT (TP-HEFT), while providing several orders of magnitude faster scheduling times in both cases. For example, for makespan minimization, GCNScheduler schedules 50-node task graphs in about 4 milliseconds while HEFT takes more than 1500 seconds; and for throughput maximization, GCNScheduler schedules 100-node task graphs in about 3.3 milliseconds, compared to about 6.9 seconds for TP-HEFT.
Effects of Different Optimization Formulations in Evolutionary Reinforcement Learning on Diverse Behavior Generation
Villin, Victor, Masuyama, Naoki, Nojima, Yusuke
Generating various strategies for a given task is challenging. However, it has already proven to bring many assets to the main learning process, such as improved behavior exploration. With the growth in the interest of heterogeneity in solution in evolutionary computation and reinforcement learning, many promising approaches have emerged. To better understand how one guides multiple policies toward distinct strategies and benefit from diversity, we need to analyze further the influence of the reward signal modulation and other evolutionary mechanisms on the obtained behaviors. To that effect, this paper considers an existing evolutionary reinforcement learning framework which exploits multi-objective optimization as a way to obtain policies that succeed at behavior-related tasks as well as completing the main goal. Experiments on the Atari games stress that optimization formulations which do not consider objectives equally fail at generating diversity and even output agents that are worse at solving the problem at hand, regardless of the obtained behaviors.
Genetic algorithms: Biologically inspired, fast-converging optimization
As you can see, beyond the details and the actual exact probability, the chances of any individual (but the first) are decreasing exponentially with k (while polynomially with m). It goes without saying that we need to apply tournament selection twice to get the pair of parents we need to generate a single element in the new population. Roulette wheel selection is definitely more complicated to implement than tournament selection, but the high-level idea is the same: higher-fitness individuals must have more chances to be selected. As we have seen, in tournament selection the probability that an element with low fitness is chosen decreases polynomially with the rank of the element (its position in the list of organisms sorted by fitness); in particular, since the probability will be O([(n-m)/n]k) the decrease will be super-linear, because k is certainly greater than 1. If, instead, we would like for lower-fitness elements to get a real chance of being selected, we could resort to a fairer selection method.
Swarm Intelligence: AI Inspired By Honeybees Can Help Us Make Better Decisions - AI Summary
But when groups are involved, with many people grabbing the wheel at once, we often find ourselves in a fruitless stalemate headed for disaster, or worse, lurching off the road and into a ditch, seemingly just to spite ourselves. It turns out that Mother Nature has been working on this problem for hundreds of millions of years, evolving countless species that make effective decisions in large groups. A human business team trying to select the ideal location for a new factory would face a similarly complex problem and find it very difficult to choose optimally, and yet simple honeybees achieve this. They do so by forming real-time systems that efficiently combine the diverse perspectives of the hundreds of scout bees that explored the available options, enabling group deliberation that considers their differing levels of conviction until they converge on a single unified decision. It enables groups of all sizes to connect over the internet and deliberate as a unified system, pushing and pulling on decisions while swarming algorithms monitor their actions and reactions.
Stock Forecast Based On a Predictive Algorithm
The Consumer Stocks Package is designed for investors and analysts who need predictions of the best performing stocks for the whole Consumer Industry. It includes 20 stocks with bullish and bearish signals. Package Name: Consumer Stocks Recommended Positions: Long Forecast Length: 1 Year (10/13/20 – 10/13/21) I Know First Average: 210.61% The algorithm correctly predicted 9 out of 10 the suggested trades for this 1 Year forecast. The top performing prediction from this package was GME with a return of 1459.83%.
Swarm intelligence: AI inspired by honeybees can help us make better decisions
Let's face it, we humans make a lot of bad decisions. And even when we are deeply aware that our decisions are hurting ourselves -- like destroying our environment or propagating inequality -- we seem collectively helpless to correct course. It is exasperating, like watching a car heading for a brick wall with a driver that seems unwilling or unable to turn the wheel. Ironically, as individuals, we are not nearly as dysfunctional, most of us turning the wheel as needed to navigate our daily lives. But when groups are involved, with many people grabbing the wheel at once, we often find ourselves in a fruitless stalemate headed for disaster, or worse, lurching off the road and into a ditch, seemingly just to spite ourselves.
Resolving Anomalies in the Behaviour of a Modularity Inducing Problem Domain with Distributional Fitness Evaluation
Qin, Zhenyue, Gedeon, Tom, I., R., McKay, null
Discrete gene regulatory networks (GRNs) play a vital role in the study of robustness and modularity. A common method of evaluating the robustness of GRNs is to measure their ability to regulate a set of perturbed gene activation patterns back to their unperturbed forms. Usually, perturbations are obtained by collecting random samples produced by a predefined distribution of gene activation patterns. This sampling method introduces stochasticity, in turn inducing dynamicity. This dynamicity is imposed on top of an already complex fitness landscape. So where sampling is used, it is important to understand which effects arise from the structure of the fitness landscape, and which arise from the dynamicity imposed on it. Stochasticity of the fitness function also causes difficulties in reproducibility and in post-experimental analyses. We develop a deterministic distributional fitness evaluation by considering the complete distribution of gene activity patterns, so as to avoid stochasticity in fitness assessment. This fitness evaluation facilitates repeatability. Its determinism permits us to ascertain theoretical bounds on the fitness, and thus to identify whether the algorithm has reached a global optimum. It enables us to differentiate the effects of the problem domain from those of the noisy fitness evaluation, and thus to resolve two remaining anomalies in the behaviour of the problem domain of~\citet{espinosa2010specialization}. We also reveal some properties of solution GRNs that lead them to be robust and modular, leading to a deeper understanding of the nature of the problem domain. We conclude by discussing potential directions toward simulating and understanding the emergence of modularity in larger, more complex domains, which is key both to generating more useful modular solutions, and to understanding the ubiquity of modularity in biological systems.
Accelerating Genetic Programming using GPUs
Sathia, Vimarsh, Ganesh, Venkataramana, Nanditale, Shankara Rao Thejaswi
Genetic Programming (GP), an evolutionary learning technique, has multiple applications in machine learning such as curve fitting, data modelling, feature selection, classification etc. GP has several inherent parallel steps, making it an ideal candidate for GPU based parallelization. This paper describes a GPU accelerated stack-based variant of the generational GP algorithm which can be used for symbolic regression and binary classification. The selection and evaluation steps of the generational GP algorithm are parallelized using CUDA. We introduce representing candidate solution expressions as prefix lists, which enables evaluation using a fixed-length stack in GPU memory. CUDA based matrix vector operations are also used for computation of the fitness of population programs. We evaluate our algorithm on synthetic datasets for the Pagie Polynomial (ranging in size from $4096$ to $16$ million points), profiling training times of our algorithm with other standard symbolic regression libraries viz. gplearn, TensorGP and KarooGP. In addition, using $6$ large-scale regression and classification datasets usually used for comparing gradient boosting algorithms, we run performance benchmarks on our algorithm and gplearn, profiling the training time, test accuracy, and loss. On an NVIDIA DGX-A100 GPU, our algorithm outperforms all the previously listed frameworks, and in particular, achieves average speedups of $119\times$ and $40\times$ against gplearn on the synthetic and large scale datasets respectively.