Evolutionary Systems
Early Diagnosis of Retinal Blood Vessel Damage via Deep Learning-Powered Collective Intelligence Models
Bhardwaj, Pranjal, Gupta, Prajjwal, Guhan, Thejineaswar, Srinivasan, Kathiravan
Early diagnosis of retinal diseases such as diabetic retinopathy has had the attention of many researchers. Deep learning through the introduction of convolutional neural networks has become a prominent solution for image-related tasks such as classification and segmentation. Most tasks in image classification are handled by deep CNNs pretrained and evaluated on imagenet dataset. However, these models do not always translate to the best result on other datasets. Devising a neural network manually from scratch based on heuristics may not lead to an optimal model as there are numerous hyperparameters in play. In this paper, we use two nature-inspired swarm algorithms: particle swarm optimization (PSO) and ant colony optimization (ACO) to obtain TDCN models to perform classification of fundus images into severity classes. The power of swarm algorithms is used to search for various combinations of convolutional, pooling, and normalization layers to provide the best model for the task. It is observed that TDCN-PSO outperforms imagenet models and existing literature, while TDCN-ACO achieves faster architecture search. The best TDCN model achieves an accuracy of 90.3%, AUC ROC of 0.956, and a Cohen kappa score of 0.967. The results were compared with the previous studies to show that the proposed TDCN models exhibit superior performance.
Review of the state of the art in autonomous artificial intelligence
Radanliev, Petar, De Roure, David
This article presents a new design for autonomous artificial intelligence (AI), based on the state-of-the-art algorithms, and describes a new autonomous AI system called AutoAI. The methodology is used to assemble the design founded on self-improved algorithms that use new and emerging sources of data (NEFD). The objective of the article is to conceptualise the design of a novel AutoAI algorithm. The conceptual approach is used to advance into building new and improved algorithms. The article integrates and consolidates the findings from existing literature and advances the AutoAI design into (1) using new and emerging sources of data for teaching and training AI algorithms and (2) enabling AI algorithms to use automated tools for training new and improved algorithms. This approach is going beyond the state-of-the-art in AI algorithms and suggests a design that enables autonomous algorithms to self-optimise and self-adapt, and on a higher level, be capable to self-procreate.
Pinaki Laskar on LinkedIn: Is there a mathematical theory of intelligence? It all depends on how you…
Is there a mathematical theory of intelligence? It all depends on how you define intelligence, as animal, human, machine or alien, or in the abstract terms, as a general mechanism transcending its specific operations and functions, as perception, cognitive processing, learning, reasoning, decision-making, and action. There are all sorts of models and approximations by means of mathematical logics, mathematical optimization, probability theory, statistic models, information theory, #computerscience. Accordingly, an intelligence could be realized in many forms and modalities, as an information entity, an animal/human being, an advanced algorithmic system, a learning software application, complex data-processing software/hardware, a sophisticated computing device, statistical machines, or a goal-directed agent, which "intelligence measures an agent's ability to achieve goals in a wide range of environments, situations, tasks and problems". The current situation is too divided, specific and fragmented.
Pareto-aware Neural Architecture Generation for Diverse Computational Budgets
Guo, Yong, Chen, Yaofo, Zheng, Yin, Chen, Qi, Zhao, Peilin, Chen, Jian, Huang, Junzhou, Tan, Mingkui
Designing feasible and effective architectures under diverse computational budgets, incurred by different applications/devices, is essential for deploying deep models in real-world applications. To achieve this goal, existing methods often perform an independent architecture search process for each target budget, which is very inefficient yet unnecessary. More critically, these independent search processes cannot share their learned knowledge (i.e., the distribution of good architectures) with each other and thus often result in limited search results. To address these issues, we propose a Pareto-aware Neural Architecture Generator (PNAG) which only needs to be trained once and dynamically produces the Pareto optimal architecture for any given budget via inference. To train our PNAG, we learn the whole Pareto frontier by jointly finding multiple Pareto optimal architectures under diverse budgets. Such a joint search algorithm not only greatly reduces the overall search cost but also improves the search results. Extensive experiments on three hardware platforms (i.e., mobile device, CPU, and GPU) show the superiority of our method over existing methods.
Censored Deep Reinforcement Patrolling with Information Criterion for Monitoring Large Water Resources using Autonomous Surface Vehicles
Luis, Samuel Yanes, Reina, Daniel Gutiérrez, Marín, Sergio Toral
Monitoring and patrolling large water resources is a major challenge for conservation. The problem of acquiring data of an underlying environment that usually changes within time involves a proper formulation of the information. The use of Autonomous Surface Vehicles equipped with water quality sensor modules can serve as an early-warning system agents for contamination peak-detection, algae blooms monitoring, or oil-spill scenarios. In addition to information gathering, the vehicle must plan routes that are free of obstacles on non-convex maps. This work proposes a framework to obtain a collision-free policy that addresses the patrolling task for static and dynamic scenarios. Using information gain as a measure of the uncertainty reduction over data, it is proposed a Deep Q-Learning algorithm improved by a Q-Censoring mechanism for model-based obstacle avoidance. The obtained results demonstrate the usefulness of the proposed algorithm for water resource monitoring for static and dynamic scenarios. Simulations showed the use of noise-networks are a good choice for enhanced exploration, with 3 times less redundancy in the paths. Previous coverage strategies are also outperformed both in the accuracy of the obtained contamination model by a 13% on average and by a 37% in the detection of dangerous contamination peaks. Finally, these results indicate the appropriateness of the proposed framework for monitoring scenarios with autonomous vehicles.
Reinforcement Learning with Automated Auxiliary Loss Search
He, Tairan, Zhang, Yuge, Ren, Kan, Liu, Minghuan, Wang, Che, Zhang, Weinan, Yang, Yuqing, Li, Dongsheng
A good state representation is crucial to solving complicated reinforcement learning (RL) challenges. Many recent works focus on designing auxiliary losses for learning informative representations. Unfortunately, these handcrafted objectives rely heavily on expert knowledge and may be sub-optimal. In this paper, we propose a principled and universal method for learning better representations with auxiliary loss functions, named Automated Auxiliary Loss Search (A2LS), which automatically searches for top-performing auxiliary loss functions for RL. Specifically, based on the collected trajectory data, we define a general auxiliary loss space of size $7.5 \times 10^{20}$ and explore the space with an efficient evolutionary search strategy. Empirical results show that the discovered auxiliary loss (namely, A2-winner) significantly improves the performance on both high-dimensional (image) and low-dimensional (vector) unseen tasks with much higher efficiency, showing promising generalization ability to different settings and even different benchmark domains. We conduct a statistical analysis to reveal the relations between patterns of auxiliary losses and RL performance.
The State-of-the-Art in AI-Based Malware Detection Techniques: A Review
Artificial Intelligence techniques have evolved rapidly in recent years, revolutionising the approaches used to fight against cybercriminals. But as the cyber security field has progressed, so has malware development, making it an economic imperative to strengthen businesses' defensive capability against malware attacks. This review aims to outline the state-of-the-art AI techniques used in malware detection and prevention, providing an in-depth analysis of the latest studies in this field. The algorithms investigated consist of Shallow Learning, Deep Learning and Bio-Inspired Computing, applied to a variety of platforms, such as PC, cloud, Android and IoT. This survey also touches on the rapid adoption of AI by cybercriminals as a means to create ever more advanced malware and exploit the AI algorithms designed to defend against them.
Story Designer: Towards a Mixed-Initiative Tool to Create Narrative Structures
Alvarez, Alberto, Font, Jose, Togelius, Julian
Narratives are a predominant part of games, and their design poses challenges when identifying, encoding, interpreting, evaluating, and generating them. One way to address this would be to approach narrative design in a more abstract layer, such as narrative structures. This paper presents Story Designer, a mixed-initiative co-creative narrative structure tool built on top of the Evolutionary Dungeon Designer (EDD) that uses tropes, narrative conventions found across many media types, to design these structures. Story Designer uses tropes as building blocks for narrative designers to compose complete narrative structures by interconnecting them in graph structures called narrative graphs. Our mixed-initiative approach lets designers manually create their narrative graphs and feeds an underlying evolutionary algorithm with those, creating quality-diverse suggestions using MAP-Elites. Suggestions are visually represented for designers to compare and evaluate and can then be incorporated into the design for further manual editions. At the same time, we use the levels designed within EDD as constraints for the narrative structure, intertwining both level design and narrative. We evaluate the impact of these constraints and the system's adaptability and expressiveness, resulting in a potential tool to create narrative structures combining level design aspects with narrative.
TropeTwist: Trope-based Narrative Structure Generation
Games are complex, multi-faceted systems that share common elements This paper presents TropeTwist, a preliminar system that uses and underlying narratives, such as the conflict between a Tropes [21, 54] extracted from TvTropes [26, 46] as patterns and fundamental hero and a big bad enemy or pursuing a goal that requires overcoming units, which when combined can compose structures further challenges. However, identifying and describing these elements representing other composed tropes. Common narrative structures together is non-trivial as they might differ in certain properties can be identified and defined using TropeTwist. TropeTwist and how players might encounter the narratives. Likewise, generating can define generic aspects of a story, leading to the identification of narratives also pose difficulties when encoding, interpreting, events, roles, and narrative elements, as well as a novel way to form and evaluating them. To address this, we present TropeTwist, a narratives. As a proof-of-concept, we built, analyzed, and described trope-based system that can describe narrative structures in games structurally three game examples shown in figure 1, top row. in a more abstract and generic level, allowing the definition of We propose graph grammars as indirect encoding of narrative games' narrative structures and their generation using interconnected graphs and the use of the Multi-dimensional Archive of Phenotypic tropes, called narrative graphs. To demonstrate the system, Elites (MAP-Elites) [40] to generate novel variations (shown we represent the narrative structure of three different games. in figure 1, bottom row) using the proof-of-concept examples as We use MAP-Elites to generate and evaluate novel quality-diverse roots. Simultaneously, we propose metrics to evaluate the resulting narrative graphs encoded as graph grammars, using these three narrative graphs' coherence, cohesion, and interestingness.
Data types as a more ergonomic frontend for Grammar-Guided Genetic Programming
Espada, Guilherme, Ingelse, Leon, Canelas, Paulo, Barbosa, Pedro, Fonseca, Alcides
Genetic Programming (GP) is an heuristic method that can be applied to many Machine Learning, Optimization and Engineering problems. In particular, it has been widely used in Software Engineering for Test-case generation, Program Synthesis and Improvement of Software (GI). Grammar-Guided Genetic Programming (GGGP) approaches allow the user to refine the domain of valid program solutions. Backus Normal Form is the most popular interface for describing Context-Free Grammars (CFG) for GGGP. BNF and its derivatives have the disadvantage of interleaving the grammar language and the target language of the program. We propose to embed the grammar as an internal Domain-Specific Language in the host language of the framework. This approach has the same expressive power as BNF and EBNF while using the host language type-system to take advantage of all the existing tooling: linters, formatters, type-checkers, autocomplete, and legacy code support. These tools have a practical utility in designing software in general, and GP systems in particular. We also present Meta-Handlers, user-defined overrides of the tree-generation system. This technique extends our object-oriented encoding with more practicability and expressive power than existing CFG approaches, achieving the same expressive power of Attribute Grammars, but without the grammar vs target language duality. Furthermore, we evidence that this approach is feasible, showing an example Python implementation as proof. We also compare our approach against textual BNF-representations w.r.t. expressive power and ergonomics. These advantages do not come at the cost of performance, as shown by our empirical evaluation on 5 benchmarks of our example implementation against PonyGE2. We conclude that our approach has better ergonomics with the same expressive power and performance of textual BNF-based grammar encodings.