Victoria
Detection of Community Structures in Networks with Nodal Features based on Generative Probabilistic Approach
Zare, Hadi, Hajiabadi, Mahdi, Jalili, Mahdi
Community detection is considered as a fundamental task in analyzing social networks. Even though many techniques have been proposed for community detection, most of them are based exclusively on the connectivity structures. However, there are node features in real networks, such as gender types in social networks, feeding behavior in ecological networks, and location on e-trading networks, that can be further leveraged with the network structure to attain more accurate community detection methods. We propose a novel probabilistic graphical model to detect communities by taking into account both network structure and nodes' features. The proposed approach learns the relevant features of communities through a generative probabilistic model without any prior assumption on the communities. Furthermore, the model is capable of determining the strength of node features and structural elements of the networks on shaping the communities. The effectiveness of the proposed approach over the state-of-the-art algorithms is revealed on synthetic and benchmark networks.
Oversampling Log Messages Using a Sequence Generative Adversarial Network for Anomaly Detection and Classification
Farzad, Amir, Gulliver, T. Aaron
Dealing with imbalanced data is one the main challenges in machine/deep learning algorithms for classification. This issue is more important with log message data as it is typically imbalanced and negative logs are rare. In this paper, a model is proposed to generate text log messages using a SeqGAN network. Then features are extracted using an Autoencoder and anomaly detection and classification is done using a GRU network. The proposed model is evaluated with two imbalanced log data sets, namely BGL and Openstack. Results are presented which show that oversampling and balancing data increases the accuracy of anomaly detection and classification. Keywords: SeqGAN · Autoencoder · GRU · Deep Learning · Neural Network · Log messages · Anomaly detection · Classification 1 Introduction Logs are commonly used in software systems such as cloud servers. Generally, these messages are imbalanced because most logs indicate arXiv:1912.04747v1
Drones From Open Ocean Robotics Make A Splash, Tackling Winter Storms And More
Prototype of the Force 12 Xplorer being tested near Victoria, British Columbia. It uses a rigid ... [ ] wingsail for propulsion. It's been a great year for Open Ocean Robotics, a British Columbia-based startup that makes solar-powered drones that can gather environmental data in real time and help address a multitude of issues. During 2019, Open Ocean Robotics won a most-promising startup award from the National Community for Angels, Incubators, and Accelerators; $100,000 in a Spring Impact Investor Challenge; and was a finalist in a New Ventures BC Competition, to name a few. So how do you follow that up for 2020?
Towards Similarity Graphs Constructed by Deep Reinforcement Learning
Baranchuk, Dmitry, Babenko, Artem
Similarity graphs are an active research direction for the nearest neighbor search (NNS) problem. New algorithms for similarity graph construction are continuously being proposed and analyzed by both theoreticians and practitioners. However, existing construction algorithms are mostly based on heuristics and do not explicitly maximize the target performance measure, i.e., search recall. Therefore, at the moment it is not clear whether the performance of similarity graphs has plateaued or more effective graphs can be constructed with more theoretically grounded methods. In this paper, we introduce a new principled algorithm, based on adjacency matrix optimization, which explicitly maximizes search efficiency. Namely, we propose a probabilistic model of a similarity graph defined in terms of its edge probabilities and show how to learn these probabilities from data as a reinforcement learning task. As confirmed by experiments, the proposed construction method can be used to refine the state-of-the-art similarity graphs, achieving higher recall rates for the same number of distance computations. Furthermore, we analyze the learned graphs and reveal the structural properties that are responsible for more efficient search.
Log Message Anomaly Detection and Classification Using Auto-B/LSTM and Auto-GRU
Farzad, Amir, Gulliver, T. Aaron
Log messages are now widely used in software systems. They are important for classification as millions of logs are generated each day. Most logs are unstructured which makes classification a challenge. In this paper, Deep Learning (DL) methods called Auto-LSTM, Auto-BLSTM and Auto-GRU are developed for anomaly detection and log classification. These models are used to convert unstructured log data to trained features which is suitable for classification algorithms. They are evaluated using four data sets, namely BGL, Openstack, Thunderbird and IMDB. The first three are popular log data sets while the fourth is a movie review data set which is used for sentiment classification and is used here to show that the models can be generalized to other text classification tasks. The results obtained show that Auto-LSTM, Auto-BLSTM and Auto-GRU perform better than other well-known algorithms.
Wise Leadership in the Age of Artificial Intelligence CEOWORLD magazine
Are robots coming for your job? According to a Dell Technologies survey, 82% of leaders expect their employees and machines to work as "integrated teams". And many employees look forward to artificial intelligence (AI) that can help them do their job better. But not everybody has such a rosy outlook. In Australia, the report "Australia's Future Workforce" predicts about 40% of jobs could be lost to robotics, automation and artificial intelligence in the next 10-15 years.
Real-Time Sensor Anomaly Detection and Recovery in Connected Automated Vehicle Sensors
Wang, Yiyang, Masoud, Neda, Khojandi, Anahita
In this paper we propose a novel observer-based method to improve the safety and security of connected and automated vehicle (CAV) transportation. The proposed method combines model-based signal filtering and anomaly detection methods. Specifically, we use adaptive extended Kalman filter (AEKF) to smooth sensor readings of a CAV based on a nonlinear car-following model. Using the car-following model the subject vehicle (i.e., the following vehicle) utilizes the leading vehicle's information to detect sensor anomalies by employing previously-trained One Class Support Vector Machine (OCSVM) models. This approach allows the AEKF to estimate the state of a vehicle not only based on the vehicle's location and speed, but also by taking into account the state of the surrounding traffic. A communication time delay factor is considered in the car-following model to make it more suitable for real-world applications. Our experiments show that compared with the AEKF with a traditional $\chi^2$-detector, our proposed method achieves a better anomaly detection performance. We also demonstrate that a larger time delay factor has a negative impact on the overall detection performance.
A Distributed Model-Free Algorithm for Multi-hop Ride-sharing using Deep Reinforcement Learning
Singh, Ashutosh, Alabbasi, Abubakr, Aggarwal, Vaneet
The growth of autonomous vehicles, ridesharing systems, and self driving technology will bring a shift in the way ride hailing platforms plan out their services. However, these advances in technology coupled with road congestion, environmental concerns, fuel usage, vehicles emissions, and the high cost of the vehicle usage have brought more attention to better utilize the use of vehicles and their capacities. In this paper, we propose a novel multi-hop ride-sharing (MHRS) algorithm that uses deep reinforcement learning to learn optimal vehicle dispatch and matching decisions by interacting with the external environment. By allowing customers to transfer between vehicles, i.e., ride with one vehicle for sometime and then transfer to another one, MHRS helps in attaining 30\% lower cost and 20\% more efficient utilization of fleets, as compared to the ride-sharing algorithms. This flexibility of multi-hop feature gives a seamless experience to customers and ride-sharing companies, and thus improves ride-sharing services.
A Deep Learning-based Framework for the Detection of Schools of Herring in Echograms
Rezvanifar, Alireza, Marques, Tunai Porto, Cote, Melissa, Albu, Alexandra Branzan, Slonimer, Alex, Tolhurst, Thomas, Ersahin, Kaan, Mudge, Todd, Gauthier, Stephane
Tracking the abundance of underwater species is crucial for understanding the effects of climate change on marine ecosystems. Biologists typically monitor underwater sites with echosounders and visualize data as 2D images (echograms); they interpret these data manually or semi-automatically, which is time-consuming and prone to inconsistencies. This paper proposes a deep learning framework for the automatic detection of schools of herring from echograms. Experiments demonstrated that our approach outperforms a traditional machine learning algorithm using hand-crafted features. Our framework could easily be expanded to detect more species of interest to sustainable fisheries.
AIBA: An AI Model for Behavior Arbitration in Autonomous Driving
Trasnea, Bogdan, pozna, Claudiu, Grigorescu, Sorin
Driving in dynamically changing traffic is a highly challenging task for autonomous vehicles, especially in crowded urban roadways. The Artificial Intelligence (AI) system of a driverless car must be able to arbitrate between different driving strategies in order to properly plan the car's path, based on an understandable traffic scene model. In this paper, an AI behavior arbitration algorithm for Autonomous Driving (AD) is proposed. The method, coined AIBA (AI Behavior Arbitration), has been developed in two stages: (i) human driving scene description and understanding and (ii) formal modelling. The description of the scene is achieved by mimicking a human cognition model, while the modelling part is based on a formal representation which approximates the human driver understanding process. The advantage of the formal representation is that the functional safety of the system can be analytically inferred. The performance of the algorithm has been evaluated in Virtual Test Drive (VTD), a comprehensive traffic simulator, and in GridSim, a vehicle kinematics engine for prototypes.