differential evolution algorithm
Online path planning for kinematic-constrained UAVs in a dynamic environment based on a Differential Evolution algorithm
Freitas, Elias J. R., Cohen, Miri Weiss, Guimarães, Frederico G., Pimenta, Luciano C. A.
In our recent work [5], we proposed a novel Differential The increasing use of fixed-wing Unmanned Aerial Vehicles Evolution-based path planner that handles kinematicconstrained (UAVs) is driven by several factors, such as longrange, UAVs. In this approach, we also show that high speeds, and superior payload capacity compared using the Non-Uniform Rational B-spline (NURBS) curve as to quadrotors. Combined with motion planning strategies, the path representation can provide a more flexible planner these advantages enable fixed-wing UAVs also to navigate than using the B-spline representation.
Model calibration using a parallel differential evolution algorithm in computational neuroscience: simulation of stretch induced nerve deficit
LaTorre, Antonio, Kwong, Man Ting, García-Grajales, Julián A., Shi, Riyi, Jérusalem, Antoine, Peña, José-María
Neuronal damage, in the form of both brain and spinal cord injuries, is one of the major causes of disability and death in young adults worldwide. One way to assess the direct damage occurring after a mechanical insult is the simulation of the neuronal cells functional deficits following the mechanical event. In this study, we use a coupled mechanical electrophysiological model with several free parameters that are required to be calibrated against experimental results. The calibration is carried out by means of an evolutionary algorithm (differential evolution, DE) that needs to evaluate each configuration of parameters on six different damage cases, each of them taking several minutes to compute. To minimise the simulation time of the parameter tuning for the DE, the stretch of one unique fixed-diameter axon with a simplified triggering process is used to speed up the calculations. The model is then leveraged for the parameter optimization of the more realistic bundle of independent axons, an impractical configuration to run on a single processor computer. To this end, we have developed a parallel implementation based on OpenMP that runs on a multi-processor taking advantage of all the available computational power. The parallel DE algorithm obtains good results, outperforming the best effort achieved by published manual calibration, in a fraction of the time. While not being able to fully capture the experimental results, the resulting nerve model provides a complex averaging framework for nerve damage simulation able to simulate gradual axonal functional alteration in a bundle.
One-Index Vector Quantization Based Adversarial Attack on Image Classification
Fan, Haiju, Qin, Xiaona, Chen, Shuang, Shum, Hubert P. H., Li, Ming
To improve storage and transmission, images are generally compressed. Vector quantization (VQ) is a popular compression method as it has a high compression ratio that suppresses other compression techniques. Despite this, existing adversarial attack methods on image classification are mostly performed in the pixel domain with few exceptions in the compressed domain, making them less applicable in real-world scenarios. In this paper, we propose a novel one-index attack method in the VQ domain to generate adversarial images by a differential evolution algorithm, successfully resulting in image misclassification in victim models. The one-index attack method modifies a single index in the compressed data stream so that the decompressed image is misclassified. It only needs to modify a single VQ index to realize an attack, which limits the number of perturbed indexes. The proposed method belongs to a semi-black-box attack, which is more in line with the actual attack scenario. We apply our method to attack three popular image classification models, i.e., Resnet, NIN, and VGG16. On average, 55.9% and 77.4% of the images in CIFAR-10 and Fashion MNIST, respectively, are successfully attacked, with a high level of misclassification confidence and a low level of image perturbation.
Multi-task multi-constraint differential evolution with elite-guided knowledge transfer for coal mine integrated energy system dispatching
Dai, Canyun, Sun, Xiaoyan, Hu, Hejuan, Song, Wei, Zhang, Yong, Gong, Dunwei
The dispatch optimization of coal mine integrated energy system is challenging due to high dimensionality, strong coupling constraints, and multiobjective. Existing constrained multiobjective evolutionary algorithms struggle with locating multiple small and irregular feasible regions, making them inaplicable to this problem. To address this issue, we here develop a multitask evolutionary algorithm framework that incorporates the dispatch correlated domain knowledge to effectively deal with strong constraints and multiobjective optimization. Possible evolutionary multitask construction strategy based on complex constraint relationship analysis and handling, i.e., constraint coupled spatial decomposition, constraint strength classification and constraint handling technique, is first explored. Within the multitask evolutionary optimization framework, two strategies, i.e., an elite guided knowledge transfer by designing a special crowding distance mechanism to select dominant individuals from each task, and an adaptive neighborhood technology based mutation to effectively balance the diversity and convergence of each optimized task for the differential evolution algorithm, are further developed. The performance of the proposed algorithm in feasibility, convergence, and diversity is demonstrated in a case study of a coal mine integrated energy system by comparing with CPLEX solver and seven constrained multiobjective evolutionary algorithms.
Differential Evolution Algorithm based Hyper-Parameters Selection of Transformer Neural Network Model for Load Forecasting
Sen, Anuvab, Mazumder, Arul Rhik, Sen, Udayon
Accurate load forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of dynamic power systems remains a challenge for traditional statistical models. For these reasons, time-series models (ARIMA) and deep-learning models (ANN, LSTM, GRU, etc.) are commonly deployed and often experience higher success. In this paper, we analyze the efficacy of the recently developed Transformer-based Neural Network model in Load forecasting. Transformer models have the potential to improve Load forecasting because of their ability to learn long-range dependencies derived from their Attention Mechanism. We apply several metaheuristics namely Differential Evolution to find the optimal hyperparameters of the Transformer-based Neural Network to produce accurate forecasts. Differential Evolution provides scalable, robust, global solutions to non-differentiable, multi-objective, or constrained optimization problems. Our work compares the proposed Transformer based Neural Network model integrated with different metaheuristic algorithms by their performance in Load forecasting based on numerical metrics such as Mean Squared Error (MSE) and Mean Absolute Percentage Error (MAPE). Our findings demonstrate the potential of metaheuristic-enhanced Transformer-based Neural Network models in Load forecasting accuracy and provide optimal hyperparameters for each model.
Metaheuristic optimization with the Differential Evolution algorithm
Learn the theory of the Differential Evolution algorithm, its Python implementation and how and why it will surely help you in solving complex real-world optimization problems. This article has been written with Salvatore Guastella. Optimization is a pillar of data science. If you think about it, under the hood of each machine learning algorithms (ranging from basic linear regression to the most complex neural networks architectures), an optimization problem is solved. Moreover, in many real-world problems the goal is to find the values of one or more decision variables that minimize (or maximize) a quantity of interest while satisfying certain constraints. Few examples are given by portfolio optimization in finance, profit maximization of ad campaigns, energy efficiency in energy plants and shipment cost minimization in logistics (refer to this Medium article [1] in our Eni digiTALKS channel for an interesting example).
Differential evolution outside the box
Kononova, Anna V., Caraffini, Fabio, Bäck, Thomas
Consequently, any optimisation algorithm, including nonlinear optimisation heuristics, should be able to deal with such constraints by means of a constraint handling method. Such a method deals with infeasible solution (IS) candidates x R D by means of a suitable approach, involving concepts such as, e.g., ignoring or repairing them. In nonlinear optimisation heuristics inspired by nature, the infeasible components of a solution are generated by the mutation operator, which is expected to help explore regions of the search space outside the scope of the crossover operator and then converge towards solution candidates for which f is minimised or maximised. Intuitively, this search process is disrupted and thus lacks the ability to adapt itself to the properties of the objective function f when it generates many infeasible solutions during the course of the search. In this paper, we present an empirical investigation of the proportion of infeasible solutions generated for various variants and parameter settings of Differential Evolution. The algorithm variants under consideration are introduced in Section 2 while the adopted methods of dealing with generated infeasible solutions, as well as the experimental setup, are introduced in Section 3. The results are discussed in Section 4 and conclusions are drawn in Section 5. 2. Differential evolution Originally intended for a simple fitting problem [36, 31], Differential Evolution (DE) has soon become an established metaheuristic method for general-purpose real-valued optimisation, finding its place among other optimisation methods for real-world applications in engineering, robotics and other fields [35, 30, 41]. Besides the effectiveness of the DE optimisation framework, its success is attributed to the simplicity of its algorithmic structure. As can be seen from the pseudocode in Algorithm 1, it requires tuning only three parameters: the population size N (i.e., number of candidate solutions), the scaling factor F (i.e., a prefixed scalar multiplier in the range p0,2s involved in the mutation process) and the crossover rate C
Differential Evolution from Scratch in Python
Differential evolution is a heuristic approach for the global optimisation of nonlinear and non- differentiable continuous space functions. The differential evolution algorithm belongs to a broader family of evolutionary computing algorithms. Similar to other popular direct search approaches, such as genetic algorithms and evolution strategies, the differential evolution algorithm starts with an initial population of candidate solutions. These candidate solutions are iteratively improved by introducing mutations into the population, and retaining the fittest candidate solutions that yield a lower objective function value. The differential evolution algorithm is advantageous over the aforementioned popular approaches because it can handle nonlinear and non-differentiable multi-dimensional objective functions, while requiring very few control parameters to steer the minimisation.