Oceania
Interview with Michael Milford – using artificial intelligence for robotic navigation
My primary interests are in the fields of spatial intelligence – how we can develop better navigation and positioning systems for robots and autonomous vehicles. My main research approach involves using a combination of traditional algorithmic approaches, modern deep learning and biologically-inspired approaches, both in terms of software and hardware. Spatial intelligence is one of the most tangible aspects of general intelligence, and hence it's a great gateway by which to progress our understanding and development of intelligence in robotics. For example, spatial intelligence can be directly observed in the brain, where multiple navigationally-relevant neurons like "place cells" can be observed, and modelled in software to create better performing robotic systems. From a technical point of view, autonomous vehicles are very good but not yet sufficiently perfect to be practicable.
A study of latent monotonic attention variants
Zeyer, Albert, Schlüter, Ralf, Ney, Hermann
End-to-end models reach state-of-the-art performance for speech recognition, but global soft attention is not monotonic, which might lead to convergence problems, to instability, to bad generalisation, cannot be used for online streaming, and is also inefficient in calculation. Monotonicity can potentially fix all of this. There are several ad-hoc solutions or heuristics to introduce monotonicity, but a principled introduction is rarely found in literature so far. In this paper, we present a mathematically clean solution to introduce monotonicity, by introducing a new latent variable which represents the audio position or segment boundaries. We compare several monotonic latent models to our global soft attention baseline such as a hard attention model, a local windowed soft attention model, and a segmental soft attention model. We can show that our monotonic models perform as good as the global soft attention model. We perform our experiments on Switchboard 300h. We carefully outline the details of our training and release our code and configs.
Probabilistic Analogical Mapping with Semantic Relation Networks
Lu, Hongjing, Ichien, Nicholas, Holyoak, Keith J.
These subprocesses are interrelated, with mapping considered to be the pivotal process (Gentner, 1983). Mapping may play a role in retrieval, as mapping a target analog to multiple potential source analogs stored in memory can help identify one or more that seems promising; and the correspondences computed by mapping support subsequent inference and schema induction. Thus, because of its centrality to analogical reasoning, the present paper focuses on the process of mapping between two analogs. We also consider the possible role that mapping may play in analog retrieval. Computational Approaches to Analogy Computational models of analogy have been developed in both artificial intelligence (AI) and cognitive science over more than half a century (for a recent review and critical analysis, see Mitchell, 2021). These models differ in many ways, both in terms of basic assumptions about the constraints that define a "good" analogy for humans, and in the detailed algorithms that accomplish analogical reasoning. For our present purposes, two broad approaches can be distinguished. The first approach, which can be termed representation matching, combines mental representations of structured knowledge about each analog with a matching process that computes some form of relational similarity, yielding a set of correspondences between the elements of the two analogs. The structured knowledge about an analog is typically assumed to approximate the content of propositions expressed in predicate calculus; e.g., the instantiated relation "hammer hits nail" might be coded as hit (hammer, nail).
Using Artificial Intelligence to Shed Light on the Star of Biscuits: The Jaffa Cake
Before Brexit, one of the greatest causes of arguments amongst British families was the question of the nature of Jaffa Cakes. Some argue that their size and host environment (the biscuit aisle) should make them a biscuit in their own right. Others consider that their physical properties (e.g. they harden rather than soften on becoming stale) suggest that they are in fact cake. In order to finally put this debate to rest, we re-purpose technologies used to classify transient events. We train two classifiers (a Random Forest and a Support Vector Machine) on 100 recipes of traditional cakes and biscuits. Our classifiers have 95 percent and 91 percent accuracy respectively. Finally we feed two Jaffa Cake recipes to the algorithms and find that Jaffa Cakes are, without a doubt, cakes. Finally, we suggest a new theory as to why some believe Jaffa Cakes are biscuits.
Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid World
Laurent, Florian, Schneider, Manuel, Scheller, Christian, Watson, Jeremy, Li, Jiaoyang, Chen, Zhe, Zheng, Yi, Chan, Shao-Hung, Makhnev, Konstantin, Svidchenko, Oleg, Egorov, Vladimir, Ivanov, Dmitry, Shpilman, Aleksei, Spirovska, Evgenija, Tanevski, Oliver, Nikov, Aleksandar, Grunder, Ramon, Galevski, David, Mitrovski, Jakov, Sartoretti, Guillaume, Luo, Zhiyao, Damani, Mehul, Bhattacharya, Nilabha, Agarwal, Shivam, Egli, Adrian, Nygren, Erik, Mohanty, Sharada
The Flatland competition aimed at finding novel approaches to solve the vehicle re-scheduling problem (VRSP). The VRSP is concerned with scheduling trips in traffic networks and the re-scheduling of vehicles when disruptions occur, for example the breakdown of a vehicle. While solving the VRSP in various settings has been an active area in operations research (OR) for decades, the ever-growing complexity of modern railway networks makes dynamic real-time scheduling of traffic virtually impossible. Recently, multi-agent reinforcement learning (MARL) has successfully tackled challenging tasks where many agents need to be coordinated, such as multiplayer video games. However, the coordination of hundreds of agents in a real-life setting like a railway network remains challenging and the Flatland environment used for the competition models these real-world properties in a simplified manner. Submissions had to bring as many trains (agents) to their target stations in as little time as possible. While the best submissions were in the OR category, participants found many promising MARL approaches. Using both centralized and decentralized learning based approaches, top submissions used graph representations of the environment to construct tree-based observations. Further, different coordination mechanisms were implemented, such as communication and prioritization between agents. This paper presents the competition setup, four outstanding solutions to the competition, and a cross-comparison between them.
Exploring Edge TPU for Network Intrusion Detection in IoT
Hosseininoorbin, Seyedehfaezeh, Layeghy, Siamak, Sarhan, Mohanad, Jurdak, Raja, Portmann, Marius
This paper explores Google's Edge TPU for implementing a practical network intrusion detection system (NIDS) at the edge of IoT, based on a deep learning approach. While there are a significant number of related works that explore machine learning based NIDS for the IoT edge, they generally do not consider the issue of the required computational and energy resources. The focus of this paper is the exploration of deep learning-based NIDS at the edge of IoT, and in particular the computational and energy efficiency. In particular, the paper studies Google's Edge TPU as a hardware platform, and considers the following three key metrics: computation (inference) time, energy efficiency and the traffic classification performance. Various scaled model sizes of two major deep neural network architectures are used to investigate these three metrics. The performance of the Edge TPU-based implementation is compared with that of an energy efficient embedded CPU (ARM Cortex A53). Our experimental evaluation shows some unexpected results, such as the fact that the CPU significantly outperforms the Edge TPU for small model sizes.
SPatchGAN: A Statistical Feature Based Discriminator for Unsupervised Image-to-Image Translation
For unsupervised image-to-image translation, we propose a discriminator architecture which focuses on the statistical features instead of individual patches. The network is stabilized by distribution matching of key statistical features at multiple scales. Unlike the existing methods which impose more and more constraints on the generator, our method facilitates the shape deformation and enhances the fine details with a greatly simplified framework. We show that the proposed method outperforms the existing state-of-the-art models in various challenging applications including selfie-to-anime, male-to-female and glasses removal. The code will be made publicly available.
Dynamic Attention guided Multi-Trajectory Analysis for Single Object Tracking
Wang, Xiao, Chen, Zhe, Tang, Jin, Luo, Bin, Wang, Yaowei, Tian, Yonghong, Wu, Feng
Most of the existing single object trackers track the target in a unitary local search window, making them particularly vulnerable to challenging factors such as heavy occlusions and out-of-view movements. Despite the attempts to further incorporate global search, prevailing mechanisms that cooperate local and global search are relatively static, thus are still sub-optimal for improving tracking performance. By further studying the local and global search results, we raise a question: can we allow more dynamics for cooperating both results? In this paper, we propose to introduce more dynamics by devising a dynamic attention-guided multi-trajectory tracking strategy. In particular, we construct dynamic appearance model that contains multiple target templates, each of which provides its own attention for locating the target in the new frame. Guided by different attention, we maintain diversified tracking results for the target to build multi-trajectory tracking history, allowing more candidates to represent the true target trajectory. After spanning the whole sequence, we introduce a multi-trajectory selection network to find the best trajectory that delivers improved tracking performance. Extensive experimental results show that our proposed tracking strategy achieves compelling performance on various large-scale tracking benchmarks. The project page of this paper can be found at https://sites.google.com/view/mt-track/.
Tuning of extended state observer with neural network-based control performance assessment
Kicki, Piotr, Łakomy, Krzysztof, Lee, Ki Myung Brian
In the literature, many methods have been proposed The extended state observer (ESO) is an inherent component for tuning bandwidth-parameterized observers. In [49] of the robust control framework that relies on the cancellation and [38], the authors presented an analytical tuning method providing of disturbances using their lumped estimate in the feedforward the best performance of the ADRC structure expressed component of the robust control law. The general idea of solely upon the control-error-dependent criteria in a noiseless such control structure was utilized in many specific robust algorithms environment. In [39] and [6], the authors considered also the such as active disturbance rejection control (ADRC) control cost as a factor that needs to be minimized to reduce the [13, 54], disturbance observer based control (DOBC) [5, 23], energy consumption of the robust control process, while in [26] or robust observer based control [16], while its applicability the observation error of the measured signals was taken into has been proven in many fields including power electronics account. Tuning procedures described in [28] and [12] have [20, 25, 46], temperature control [53], motion control [32, 42], utilized prior knowledge about the plant structure and some and robotics [30, 22]. Besides the fact that there is a wide variety known or identified model parameters to obtain assumed control of ESO architectures that deal with disadvantages of a most performance requirements. In [28] and [14], the authors commonly used Luenberger-like extended high-gain observer presented an observer tuning method that is relative to gains (HGO) [52, 8] in terms of the general disturbance observation of the selected ADRC controller. Some methods consider automatic quality [34], transient performance [40], or the robustness to tools designed for tuning the overall ADRC structure, measurement noise [37, 21], the final characteristics of the control including observer gains, to satisfy some predefined criteria determining system performance depend greatly on the appropriate tuning the robustness of the control structure [36].
Top 6 Countries with Growing Shortage of Data Science, AI/ML and Deep Learning Talent
This is the land of Spotify and many tech-driven firms. Sweden is one of the countries where there's a large presence of multinational IT firms and start-up tech companies with constant work in the field of research and development. With such a focus on R&D, it has several technology parks as well and all of this calls for a huge number of qualified IT professionals and data scientists throughout the country. The major companies in the field of data science in Sweden are vert well aware of the importance for individuals skilled in data science, AI/ML and deep learning. As per the reports, Sweden continually keeps facing a shortage of IT and Data science professionals and this in the past led to a shortage of more than 30 thousand IT and practitioners in 2012 and the numbers are even higher now as the supply to their demands are never met. Rather the inflation keeps increasing each passing minute. As the Swedish customers are also gaining awareness and maturity in the IT and tech products or associated products and services, demands for the individuals skilled in same are very much of crucial importance here. Reports also suggest that by 2035 Sweden is going to have to face a major shortage of individuals skilled in IT and Engineering fields at both junior and senior levels of the company hierarchy.