Oceania
QUT predicts erratic flight paths with multiple machine learning techniques
Researchers at the Queensland University of Technology have developed an algorithm that uses a pair of machine learning techniques to quickly and accurately predict aircraft trajectories and flight paths. The algorithm was designed to increase the understanding of how airspace is used from a defence perspective, but could also be applied to civilian air traffic control or any scenario in which movement needs to be analysed. Data is fed into two neural networks - deep neural networks, which analyse data at multiple levels to predict the probability of outcomes with increasing accuracy; and memory networks, which feature a memory component that can be read from and written to. "In essence, it's built to measure a trajectory in and predict a trajectory out," professor Clinton Fookes from the university's Vision and Signal Processing discipline said. "But as it's taking in the trajectory of the target object, it's also taking in the trajectories of neighbouring objects to create an awareness of what's around the target and how those objects are moving."
A Novel Topology Optimization Approach using Conditional Deep Learning
Rawat, Sharad, Shen, M. -H. Herman
Topology design optimization offers a tremendous opportunity in design and manufacturing freedoms by designing and producing a part from the ground-up without a meaningful initial design as required by conventional shape design optimization approaches. Ideally, with adequate problem statements, to formulate and solve the topology design problem using a standard topology optimization process, such as SIMP (Simplified Isotropic Material with Penalization) is possible. However, in reality, an estimated over thousands of design iterations is often required for just a few design variables, the conventional optimization approach is, in general, impractical or computationally unachievable for real-world applications significantly diluting the development of the topology optimization technology. There is, therefore, a need for a different approach that will be able to optimize the initial design topology effectively and rapidly. In this study, a novel topology optimization approach based on conditional Wasserstein generative adversarial networks (CWGAN) is developed to replicate the conventional topology optimization algorithms in an extremely computationally inexpensive way. CWGAN consists of a generator and a discriminator, both of which are deep convolutional neural networks (CNN). The limited samples of data, quasi-optimal planar structures, needed for training purposes are generated using the conventional topology optimization algorithms. With CWGANs, the topology optimization conditions can be set to a required value before generating samples.
Comparing Knowledge-based Reinforcement Learning to Neural Networks in a Strategy Game
Nechepurenko, Liudmyla, Voss, Viktor, Gritsenko, Vyacheslav
We compare a novel Knowledge-based Reinforcement Learning (KB-RL) approach with the traditional Neural Network (NN) method in solving a classical task of the Artificial Intelligence (AI) field. Neural networks became very prominent in recent years and, combined with Reinforcement Learning, proved to be very effective for one of the frontier challenges in AI - playing the game of Go. Our experiment shows that a KB-RL system is able to outperform a NN in a task typical for NN, such as optimizing a regression problem. Furthermore, KB-RL offers a range of advantages in comparison to the traditional Machine Learning methods. Particularly, there is no need for a large dataset to start and succeed with this approach, its learning process takes considerably less effort, and its decisions are fully controllable, explicit and predictable.
A Joint Model for Multimodal Document Quality Assessment
Shen, Aili, Salehi, Bahar, Baldwin, Timothy, Qi, Jianzhong
The quality of a document is affected by various factors, including grammaticality, readability, stylistics, and expertise depth, making the task of document quality assessment a complex one. In this paper, we explore this task in the context of assessing the quality of Wikipedia articles and academic papers. Observing that the visual rendering of a document can capture implicit quality indicators that are not present in the document text --- such as images, font choices, and visual layout --- we propose a joint model that combines the text content with a visual rendering of the document for document quality assessment. Experimental results over two datasets reveal that textual and visual features are complementary, achieving state-of-the-art results.
Sales Demand Forecast in E-commerce using a Long Short-Term Memory Neural Network Methodology
Bandara, Kasun, Shi, Peibei, Bergmeir, Christoph, Hewamalage, Hansika, Tran, Quoc, Seaman, Brian
Generating accurate and reliable sales forecasts is crucial in the E-commerce business. The current state-of-the-art techniques are typically univariate methods, which produce forecasts considering only the historical sales data of a single product. However, in a situation where large quantities of related time series are available, conditioning the forecast of an individual time series on past behaviour of similar, related time series can be beneficial. Given that the product assortment hierarchy in an E-commerce platform contains large numbers of related products, in which the sales demand patterns can be correlated, our attempt is to incorporate this cross-series information in a unified model. We achieve this by globally training a Long Short-Term Memory network (LSTM) that exploits the nonlinear demand relationships available in an E-commerce product assortment hierarchy. Aside from the forecasting engine, we propose a systematic pre-processing framework to overcome the challenges in an E-commerce setting. We also introduce several product grouping strategies to supplement the LSTM learning schemes, in situations where sales patterns in a product portfolio are disparate. We empirically evaluate the proposed forecasting framework on a real-world online marketplace dataset from Walmart. com. Our method achieves competitive results on category level and super-departmental level datasets, outperforming state-of-the-art techniques.
Geometrization of deep networks for the interpretability of deep learning systems
How to understand deep learning systems remains an open problem. In this paper we propose that the answer may lie in the geometrization of deep networks. Geometrization is a bridge to connect physics, geometry, deep network and quantum computation and this may result in a new scheme to reveal the rule of the physical world. By comparing the geometry of image matching and deep networks, we show that geometrization of deep networks can be used to understand existing deep learning systems and it may also help to solve the interpretability problem of deep learning systems.
Generalization in Deep Networks: The Role of Distance from Initialization
Nagarajan, Vaishnavh, Kolter, J. Zico
Why does training deep neural networks using stochastic gradient descent (SGD) result in a generalization error that does not worsen with the number of parameters in the network? To answer this question, we advocate a notion of effective model capacity that is dependent on {\em a given random initialization of the network} and not just the training algorithm and the data distribution. We provide empirical evidences that demonstrate that the model capacity of SGD-trained deep networks is in fact restricted through implicit regularization of {\em the $\ell_2$ distance from the initialization}. We also provide theoretical arguments that further highlight the need for initialization-dependent notions of model capacity. We leave as open questions how and why distance from initialization is regularized, and whether it is sufficient to explain generalization.
The Global Telecoms Market: Key Trends for 2019 - New Opportunities Emerging for the Telecoms Sector
Data centres are expanding internationally 3.2.5 Growing maintenance and energy costs 3.2.6 Case study: Australia 3.2.7 Glimpses of the future 4. 5G trends 4.1 5G is an evolutionary process 4.2 5G in the global context 4.2.1 5G statistics and forecasts 4.3 The spectrum issue 4.3.1 5G spectrum developments 4.3.2
Optimizing Answer Set Computation via Heuristic-Based Decomposition
Calimeri, Francesco, Perri, Simona, Zangari, Jessica
Answer Set Programming (ASP) is a purely declarative formalism developed in the field of logic programming and nonmonotonic reasoning: computational problems are encoded by logic programs whose answer sets, corresponding to solutions, are computed by an ASP system. Different, semantically equivalent, programs can be defined for the same problem; however, performance of systems evaluating them might significantly vary. We propose an approach for automatically transforming an input logic program into an equivalent one that can be evaluated more efficiently. One can make use of existing tree-decomposition techniques for rewriting selected rules into a set of multiple ones; the idea is to guide and adaptively apply them on the basis of proper new heuristics, to obtain a smart rewriting algorithm to be integrated into an ASP system. The method is rather general: it can be adapted to any system and implement different preference policies. Furthermore, we define a set of new heuristics tailored at optimizing grounding, one of the main phases of the ASP computation; we use them in order to implement the approach into the ASP system DLV, in particular into its grounding subsystem I-DLV, and carry out an extensive experimental activity for assessing the impact of the proposal. Under consideration in Theory and Practice of Logic Programming (TPLP).
Cooperative event-based rigid formation control
Sun, Zhiyong, Liu, Qingchen, Huang, Na, Yu, Changbin, Anderson, Brian D. O.
This paper discusses cooperative stabilization control of rigid formations via an event-based approach. We first design a centralized event-based formation control system, in which a central event controller determines the next triggering time and broadcasts the event signal to all the agents for control input update. We then build on this approach to propose a distributed event control strategy, in which each agent can use its local event trigger and local information to update the control input at its own event time. For both cases, the triggering condition, event function and triggering behavior are discussed in detail, and the exponential convergence of the event-based formation system is guaranteed.