Goto

Collaborating Authors

 Evolutionary Systems


A Novel Training Protocol for Performance Predictors of Evolutionary Neural Architecture Search Algorithms

arXiv.org Artificial Intelligence

Evolutionary Neural Architecture Search (ENAS) can automatically design the architectures of Deep Neural Networks (DNNs) using evolutionary computation algorithms. However, most ENAS algorithms require intensive computational resource, which is not necessarily available to the users interested. Performance predictors are a type of regression models which can assist to accomplish the search, while without exerting much computational resource. Despite various performance predictors have been designed, they employ the same training protocol to build the regression models: 1) sampling a set of DNNs with performance as the training dataset, 2) training the model with the mean square error criterion, and 3) predicting the performance of DNNs newly generated during the ENAS. In this paper, we point out that the three steps constituting the training protocol are not well though-out through intuitive and illustrative examples. Furthermore, we propose a new training protocol to address these issues, consisting of designing a pairwise ranking indicator to construct the training target, proposing to use the logistic regression to fit the training samples, and developing a differential method to building the training instances. To verify the effectiveness of the proposed training protocol, four widely used regression models in the field of machine learning have been chosen to perform the comparisons on two benchmark datasets. The experimental results of all the comparisons demonstrate that the proposed training protocol can significantly improve the performance prediction accuracy against the traditional training protocols.


How This Startup Is Using Swarm AI To Make Deep Learning Technology Accessible For Everyone

#artificialintelligence

Swarm AI is a modern AI technology that is relatively new to organisations. It blends global and local insights to improve and optimise business decisions. Though the concept of swarm intelligence is now new in literature, it is increasingly being used to predict everything from stock market movements to forecasting sales. Advances in the Internet of Things technology, machine learning and 5G has made artificial swarm systems faster and more efficient. In today's world of business that constantly witnesses increasing flux, scale, and complexity, artificial swarm intelligence will help them identify new growth opportunities as well as to anticipate and manage disruption.


PSO-PS: Parameter Synchronization with Particle Swarm Optimization for Distributed Training of Deep Neural Networks

arXiv.org Artificial Intelligence

Parameter updating is an important stage in parallelism-based distributed deep learning. Synchronous methods are widely used in distributed training the Deep Neural Networks (DNNs). To reduce the communication and synchronization overhead of synchronous methods, decreasing the synchronization frequency (e.g., every $n$ mini-batches) is a straightforward approach. However, it often suffers from poor convergence. In this paper, we propose a new algorithm of integrating Particle Swarm Optimization (PSO) into the distributed training process of DNNs to automatically compute new parameters. In the proposed algorithm, a computing work is encoded by a particle, the weights of DNNs and the training loss are modeled by the particle attributes. At each synchronization stage, the weights are updated by PSO from the sub weights gathered from all workers, instead of averaging the weights or the gradients. To verify the performance of the proposed algorithm, the experiments are performed on two commonly used image classification benchmarks: MNIST and CIFAR10, and compared with the peer competitors at multiple different synchronization configurations. The experimental results demonstrate the competitiveness of the proposed algorithm.


Adversarial Image Generation and Training for Deep Neural Networks

arXiv.org Machine Learning

Deep neural networks (DNNs) have achieved great success in image classification, but they may be very vulnerable to adversarial attacks with small perturbations to images. Moreover, the adversarial training based on adversarial image samples has been shown to improve the robustness and generalization of DNNs. The aim of this paper is to develop a novel framework based on information-geometry sensitivity analysis and the particle swarm optimization to improve two aspects of adversarial image generation and training for DNNs. The first one is customized generation of adversarial examples. It can design adversarial attacks from options of the number of perturbed pixels, the misclassification probability, and the targeted incorrect class, and hence it is more flexible and effective to locate vulnerable pixels and also enjoys certain adversarial universality. The other is targeted adversarial training. DNN models can be improved in training with the adversarial information using a manifold-based influence measure effective in vulnerable image/pixel detection as well as allowing for targeted attacks, thereby exhibiting an enhanced adversarial defense in testing.


Particle Swarm Optimized Federated Learning For Industrial IoT and Smart City Services

arXiv.org Machine Learning

Most of the research on Federated Learning (FL) has focused on analyzing global optimization, privacy, and communication, with limited attention focusing on analyzing the critical matter of performing efficient local training and inference at the edge devices. One of the main challenges for successful and efficient training and inference on edge devices is the careful selection of parameters to build local Machine Learning (ML) models. To this aim, we propose a Particle Swarm Optimization (PSO)-based technique to optimize the hyperparameter settings for the local ML models in an FL environment. We evaluate the performance of our proposed technique using two case studies. First, we consider smart city services and use an experimental transportation dataset for traffic prediction as a proxy for this setting. Second, we consider Industrial IoT (IIoT) services and use the real-time telemetry dataset to predict the probability that a machine will fail shortly due to component failures. Our experiments indicate that PSO provides an efficient approach for tuning the hyperparameters of deep Long short-term memory (LSTM) models when compared to the grid search method. Our experiments illustrate that the number of clients-server communication rounds to explore the landscape of configurations to find the near-optimal parameters are greatly reduced (roughly by two orders of magnitude needing only 2%--4% of the rounds compared to state of the art non-PSO-based approaches). We also demonstrate that utilizing the proposed PSO-based technique to find the near-optimal configurations for FL and centralized learning models does not adversely affect the accuracy of the models.


A Benchmark for Multi-UAV Task Assignment of an Extended Team Orienteering Problem

arXiv.org Artificial Intelligence

A benchmark for multi-UAV task assignment is presented in order to evaluate different algorithms. An extended Team Orienteering Problem is modeled for a kind of multi-UAV task assignment problem. Three intelligent algorithms, i.e., Genetic Algorithm, Ant Colony Optimization and Particle Swarm Optimization are implemented to solve the problem. A series of experiments with different settings are conducted to evaluate three algorithms. The modeled problem and the evaluation results constitute a benchmark, which can be used to evaluate other algorithms used for multi-UAV task assignment problems.


Classification of Complex Systems Based on Transients

arXiv.org Artificial Intelligence

In order to develop systems capable of modeling artificial life, we need to identify, which systems can produce complex behavior. We present a novel classification method applicable to any class of deterministic discrete space and time dynamical systems. The method distinguishes between different asymptotic behaviors of a system's average computation time before entering a loop. When applied to elementary cellular automata, we obtain classification results, which correlate very well with Wolfram's manual classification. Further, we use it to classify 2D cellular automata to show that our technique can easily be applied to more complex models of computation. We believe this classification method can help to develop systems, in which complex structures emerge.


AI-based Modeling and Data-driven Evaluation for Smart Manufacturing Processes

arXiv.org Machine Learning

Abstract--Smart Manufacturing refers to optimization techniques that are implemented in production operations by utilizing advanced analytics approaches. With the widespread increase in deploying Industrial Internet of Things (IIoT) sensors in manufacturing processes, there is a progressive need for optimal and effective approaches to data management. Embracing Machine Learning and Artificial Intelligence to take advantage of manufacturing data can lead to efficient and intelligent automation. In this paper, we conduct a comprehensive analysis based on Evolutionary Computing and Deep Learning algorithms toward making semiconductor manufacturing smart. Computing, in manufacturing, provides access to valuable data at different levels, i.e., manufacturing enterprise, manufacturing equipment, and manufacturing processes. VER recent decades, the manufacturing industry witnessed tremendous advances in the form of four major manufacturing insights. Manufacturing, then, can be controlled paradigm shifts. In the latest industrial revolution, Industry 4.0, by leading-edge CI and Artificial Intelligence (AI), and tasks manufacturing has embraced the Industrial Internet of Things are modelled based on experimental observations, to enhance (IIoT) [1]-[3] and Machine Learning (ML) to enable machinery productivity while reducing costs. In doing so, it is of so can make industry processes smart. Broadly speaking, Smart great importance to identify which factors play a pivotal role in Manufacturing (SM) can be defined as a data-driven approach process outcomes.


Ants can orienteer a thief in their robbery

arXiv.org Artificial Intelligence

The Thief Orienteering Problem (ThOP) is a multi-component problem that combines features of two classic combinatorial optimization problems: Orienteering Problem and Knapsack Problem. The ThOP is challenging due to the given time constraint and the interaction between its components. We propose an Ant Colony Optimization algorithm together with a new packing heuristic to deal individually and interactively with problem components. Our approach outperforms existing work on more than 90% of the benchmarking instances, with an average improvement of over 300%.


Artificial Intelligence I: Basics and Games in Java

#artificialintelligence

Free Coupon Discount - Artificial Intelligence I: Basics and Games in Java, A guide how to create smart applications, AI, genetic algorithms, pruning, heuristics and metaheuristics and Tic Tac Toe Created by Holczer Balazs Students also bought Artificial Intelligence IV - Reinforcement Learning in Java Java Programming Essentials: AP Computer Science A Beginners Eclipse Java IDE Training Course Artificial Intelligence III - Deep Learning in Java Java Swing (GUI) Programming: From Beginner to Expert Preview this Udemy Course GET COUPON CODE Description This course is about the fundamental concepts of artificial intelligence. This topic is getting very hot nowadays because these learning algorithms can be used in several fields from software engineering to investment banking. Learning algorithms can recognize patterns which can help detecting cancer for example. We may construct algorithms that can have a very good guess about stock price movement in the market. Section 1: path findinf algorithms graph traversal (BFS and DFS) enhanced search algorihtms A* search algorithm Section 2: basic optimization algorithms brute-force search stochastic search and hill climbing algorithm Section 3: heuristics and meta-heuristics tabu search simulated annealing genetic algorithms particle swarm optimization Section 4: minimax algorithm game trees applications of game trees in chess Tic Tac Toe game and its implementation In the first chapter we are going to talk about the basic graph algorithms.