Parameter updating is an important stage in parallelism-based distributed deep learning. Synchronous methods are widely used in distributed training the Deep Neural Networks (DNNs). To reduce the communication and synchronization overhead of synchronous methods, decreasing the synchronization frequency (e.g., every $n$ mini-batches) is a straightforward approach. However, it often suffers from poor convergence. In this paper, we propose a new algorithm of integrating Particle Swarm Optimization (PSO) into the distributed training process of DNNs to automatically compute new parameters. In the proposed algorithm, a computing work is encoded by a particle, the weights of DNNs and the training loss are modeled by the particle attributes. At each synchronization stage, the weights are updated by PSO from the sub weights gathered from all workers, instead of averaging the weights or the gradients. To verify the performance of the proposed algorithm, the experiments are performed on two commonly used image classification benchmarks: MNIST and CIFAR10, and compared with the peer competitors at multiple different synchronization configurations. The experimental results demonstrate the competitiveness of the proposed algorithm.

Deep neural networks (DNNs) have achieved great success in image classification, but they may be very vulnerable to adversarial attacks with small perturbations to images. Moreover, the adversarial training based on adversarial image samples has been shown to improve the robustness and generalization of DNNs. The aim of this paper is to develop a novel framework based on information-geometry sensitivity analysis and the particle swarm optimization to improve two aspects of adversarial image generation and training for DNNs. The first one is customized generation of adversarial examples. It can design adversarial attacks from options of the number of perturbed pixels, the misclassification probability, and the targeted incorrect class, and hence it is more flexible and effective to locate vulnerable pixels and also enjoys certain adversarial universality. The other is targeted adversarial training. DNN models can be improved in training with the adversarial information using a manifold-based influence measure effective in vulnerable image/pixel detection as well as allowing for targeted attacks, thereby exhibiting an enhanced adversarial defense in testing.

Most of the research on Federated Learning (FL) has focused on analyzing global optimization, privacy, and communication, with limited attention focusing on analyzing the critical matter of performing efficient local training and inference at the edge devices. One of the main challenges for successful and efficient training and inference on edge devices is the careful selection of parameters to build local Machine Learning (ML) models. To this aim, we propose a Particle Swarm Optimization (PSO)-based technique to optimize the hyperparameter settings for the local ML models in an FL environment. We evaluate the performance of our proposed technique using two case studies. First, we consider smart city services and use an experimental transportation dataset for traffic prediction as a proxy for this setting. Second, we consider Industrial IoT (IIoT) services and use the real-time telemetry dataset to predict the probability that a machine will fail shortly due to component failures. Our experiments indicate that PSO provides an efficient approach for tuning the hyperparameters of deep Long short-term memory (LSTM) models when compared to the grid search method. Our experiments illustrate that the number of clients-server communication rounds to explore the landscape of configurations to find the near-optimal parameters are greatly reduced (roughly by two orders of magnitude needing only 2%--4% of the rounds compared to state of the art non-PSO-based approaches). We also demonstrate that utilizing the proposed PSO-based technique to find the near-optimal configurations for FL and centralized learning models does not adversely affect the accuracy of the models.

A benchmark for multi-UAV task assignment is presented in order to evaluate different algorithms. An extended Team Orienteering Problem is modeled for a kind of multi-UAV task assignment problem. Three intelligent algorithms, i.e., Genetic Algorithm, Ant Colony Optimization and Particle Swarm Optimization are implemented to solve the problem. A series of experiments with different settings are conducted to evaluate three algorithms. The modeled problem and the evaluation results constitute a benchmark, which can be used to evaluate other algorithms used for multi-UAV task assignment problems.

In order to develop systems capable of modeling artificial life, we need to identify, which systems can produce complex behavior. We present a novel classification method applicable to any class of deterministic discrete space and time dynamical systems. The method distinguishes between different asymptotic behaviors of a system's average computation time before entering a loop. When applied to elementary cellular automata, we obtain classification results, which correlate very well with Wolfram's manual classification. Further, we use it to classify 2D cellular automata to show that our technique can easily be applied to more complex models of computation. We believe this classification method can help to develop systems, in which complex structures emerge.

Abstract--Smart Manufacturing refers to optimization techniques that are implemented in production operations by utilizing advanced analytics approaches. With the widespread increase in deploying Industrial Internet of Things (IIoT) sensors in manufacturing processes, there is a progressive need for optimal and effective approaches to data management. Embracing Machine Learning and Artificial Intelligence to take advantage of manufacturing data can lead to efficient and intelligent automation. In this paper, we conduct a comprehensive analysis based on Evolutionary Computing and Deep Learning algorithms toward making semiconductor manufacturing smart. Computing, in manufacturing, provides access to valuable data at different levels, i.e., manufacturing enterprise, manufacturing equipment, and manufacturing processes. VER recent decades, the manufacturing industry witnessed tremendous advances in the form of four major manufacturing insights. Manufacturing, then, can be controlled paradigm shifts. In the latest industrial revolution, Industry 4.0, by leading-edge CI and Artificial Intelligence (AI), and tasks manufacturing has embraced the Industrial Internet of Things are modelled based on experimental observations, to enhance (IIoT) [1]-[3] and Machine Learning (ML) to enable machinery productivity while reducing costs. In doing so, it is of so can make industry processes smart. Broadly speaking, Smart great importance to identify which factors play a pivotal role in Manufacturing (SM) can be defined as a data-driven approach process outcomes.

The Thief Orienteering Problem (ThOP) is a multi-component problem that combines features of two classic combinatorial optimization problems: Orienteering Problem and Knapsack Problem. The ThOP is challenging due to the given time constraint and the interaction between its components. We propose an Ant Colony Optimization algorithm together with a new packing heuristic to deal individually and interactively with problem components. Our approach outperforms existing work on more than 90% of the benchmarking instances, with an average improvement of over 300%.

Free Coupon Discount - Artificial Intelligence I: Basics and Games in Java, A guide how to create smart applications, AI, genetic algorithms, pruning, heuristics and metaheuristics and Tic Tac Toe Created by Holczer Balazs Students also bought Artificial Intelligence IV - Reinforcement Learning in Java Java Programming Essentials: AP Computer Science A Beginners Eclipse Java IDE Training Course Artificial Intelligence III - Deep Learning in Java Java Swing (GUI) Programming: From Beginner to Expert Preview this Udemy Course GET COUPON CODE Description This course is about the fundamental concepts of artificial intelligence. This topic is getting very hot nowadays because these learning algorithms can be used in several fields from software engineering to investment banking. Learning algorithms can recognize patterns which can help detecting cancer for example. We may construct algorithms that can have a very good guess about stock price movement in the market. Section 1: path findinf algorithms graph traversal (BFS and DFS) enhanced search algorihtms A* search algorithm Section 2: basic optimization algorithms brute-force search stochastic search and hill climbing algorithm Section 3: heuristics and meta-heuristics tabu search simulated annealing genetic algorithms particle swarm optimization Section 4: minimax algorithm game trees applications of game trees in chess Tic Tac Toe game and its implementation In the first chapter we are going to talk about the basic graph algorithms.

In computational In this paper, we present an evolutionary path planning intelligence research, the concept is used more broadly to approach for shepherding that takes into account the collection model and analyze the behaviour of biologically inspired and movement of the swarm (sheep) in addition to the swarms, where multiple agents of different type interact with sheepdog. The problem is different from conventional path each other in a proactive and reactive manner. The reactive planning for robot navigation in the sense that the control agents are analogous to the sheep in the problem; they respond agents (sheepdog) have access to global information when to the presence of the proactive agent, the sheepdog, and are seeking an optimal path, while the movement of others (sheep) repulsed from it. The sheepdog makes a sequence of decisions is purely reactive. The two-phase algorithm starts by identifying to influence the sheep and to guide them towards a goal the path for the sheepdog to move from any initial position area. A recent comprehensive review on the subject can be to a position behind the swarm. The path is constrained to be found in [1]. The shepherding problem using robotic swarms obstacle free and so as not to impact the sheep; lest the sheep is of interest in several applications beyond the biological be repulsed and scatter, making their collection even harder inspiration of shepherding itself; applications include crowd and more time-consuming. In the second phase, the algorithm control [2], cleanup of oil spills [3], disaster relief and rescue plans the path for the sheepdog by identifying the next series operations [4], and security/military procedures [5], among of way points to guide the sheep towards their final destination.

Low level classification extracts features from the elements, i.e. physical to use them to train a model for a later classification. High level classification uses high level features, the existent patterns, relationship between the data and combines low and high level features for classification. High Level features can be got from Complex Network created over the data. Local and global features are used to describe the structure of a Complex Network, i.e. Average Neighbor Degree, Average Clustering.The present work proposed a novel feature to describe the architecture of the Network following a Ant Colony System approach. The experiments shows the advantage of using this feature because the sensibility with data of different classes.