Goto

Collaborating Authors

 Oceania


Graph Neural Networks for Traffic Forecasting

arXiv.org Artificial Intelligence

The significant increase in world population and urbanisation has brought several important challenges, in particular regarding the sustainability, maintenance and planning of urban mobility. At the same time, the exponential increase of computing capability and of available sensor and location data have offered the potential for innovative solutions to these challenges. In this work, we focus on the challenge of traffic forecasting and review the recent development and application of graph neural networks (GNN) to this problem. GNNs are a class of deep learning methods that directly process the input as graph data. This leverages more directly the spatial dependencies of traffic data and makes use of the advantages of deep learning producing state-of-the-art results. We introduce and review the emerging topic of GNNs, including their most common variants, with a focus on its application to traffic forecasting. We address the different ways of modelling traffic forecasting as a (temporal) graph, the different approaches developed so far to combine the graph and temporal learning components, as well as current limitations and research opportunities.


Towards On-Device Federated Learning: A Direct Acyclic Graph-based Blockchain Approach

arXiv.org Artificial Intelligence

Due to the distributed characteristics of Federated Learning (FL), the vulnerability of global model and coordination of devices are the main obstacle. As a promising solution of decentralization, scalability and security, leveraging blockchain in FL has attracted much attention in recent years. However, the traditional consensus mechanisms designed for blockchain like Proof of Work (PoW) would cause extreme resource consumption, which reduces the efficiency of FL greatly, especially when the participating devices are wireless and resource-limited. In order to address device asynchrony and anomaly detection in FL while avoiding the extra resource consumption caused by blockchain, this paper introduces a framework for empowering FL using Direct Acyclic Graph (DAG)-based blockchain systematically (DAG-FL). Accordingly, DAG-FL is first introduced from a three-layer architecture in details, and then two algorithms DAG-FL Controlling and DAG-FL Updating are designed running on different nodes to elaborate the operation of DAG-FL consensus mechanism. After that, a Poisson process model is formulated to discuss that how to set deployment parameters to maintain DAG-FL stably in different federated learning tasks. The extensive simulations and experiments show that DAG-FL can achieve better performance in terms of training efficiency and model accuracy compared with the typical existing on-device federated learning systems as the benchmarks.


watchOS 7.4 arrives with an easier way to unlock your iPhone

Engadget

Along with iOS 14.5, Apple has rolled out updates to its other operating systems. One of the key features of the latest iOS firmware is an easier way to unlock your iPhone. As long as you're wearing an Apple Watch running watchOS 7.4, you can unlock your device without the need for a Face ID match or passcode. The idea is to help people access their phones faster when we're still wearing masks much of the time. It'll save you having to pull down your mask to unlock your phone with Face ID. You'll need to turn on the "Unlock with Apple Watch" option in your iPhone's Face ID & Passcode settings to use the feature.


Ocado's robotic workforce can fulfil a 50 item order in five minutes, the firm claims

Daily Mail - Science & tech

A fleet of 3,000 washing machine-like robots working inside Ocado's London warehouse can fill a 50-item grocery order in just five minutes, the firm claims. They travel along a grid inside the 563,000 square foot London warehouse and are controlled'like pieces on a chessboard' by an AI air traffic controller. As they move along the board, coming within a fraction of an inch of each other, they grab items and prepare them to be delivered to the customer in a process that can take just 15 minutes to process an order with 99 per cent accuracy, Ocado claims. The British online supermarket is now as much a technology company as it is a grocer, licensing its automation system to retailers around the world. Ocado's chief of advanced technology, Alex Harvey, said the eventual goal is to become fully automated and have items'out the door without a single human touch.'


4 Business Strategies for Implementing Artificial Intelligence

#artificialintelligence

Artificial intelligence (AI) is reinventing industry after industry. In China, AI is tutoring children in more than 1700 schools across 200 cities. In Australia, an AI created a flu vaccine that far outperformed all other existing flu vaccines. In the US, a machine-learning robot is autonomously cooking burgers. There are many incredible real world-implementations of AI.


Computational Performance of Deep Reinforcement Learning to find Nash Equilibria

arXiv.org Artificial Intelligence

We test the performance of deep deterministic policy gradient (DDPG), a deep reinforcement learning algorithm, able to handle continuous state and action spaces, to learn Nash equilibria in a setting where firms compete in prices. These algorithms are typically considered model-free because they do not require transition probability functions (as in e.g., Markov games) or predefined functional forms. Despite being model-free, a large set of parameters are utilized in various steps of the algorithm. These are e.g., learning rates, memory buffers, state-space dimensioning, normalizations, or noise decay rates and the purpose of this work is to systematically test the effect of these parameter configurations on convergence to the analytically derived Bertrand equilibrium. We find parameter choices that can reach convergence rates of up to 99%. The reliable convergence may make the method a useful tool to study strategic behavior of firms even in more complex settings. Keywords: Bertrand Equilibrium, Competition in Uniform Price Auctions, Deep Deterministic Policy Gradient Algorithm, Parameter Sensitivity Analysis


Unsupervised Instance Selection with Low-Label, Supervised Learning for Outlier Detection

arXiv.org Artificial Intelligence

The laborious process of labeling data often bottlenecks projects that aim to leverage the power of supervised machine learning. Active Learning (AL) has been established as a technique to ameliorate this condition through an iterative framework that queries a human annotator for labels of instances with the most uncertain class assignment. Via this mechanism, AL produces a binary classifier trained on less labeled data but with little, if any, loss in predictive performance. Despite its advantages, AL can have difficulty with class-imbalanced datasets and results in an inefficient labeling process. To address these drawbacks, we investigate our unsupervised instance selection (UNISEL) technique followed by a Random Forest (RF) classifier on 10 outlier detection datasets under low-label conditions. These results are compared to AL performed on the same datasets. Further, we investigate the combination of UNISEL and AL. Results indicate that UNISEL followed by an RF performs comparably to AL with an RF and that the combination of UNISEL and AL demonstrates superior performance. The practical implications of these findings in terms of time savings and generalizability afforded by UNISEL are discussed.


Represent Items by Items: An Enhanced Representation of the Target Item for Recommendation

arXiv.org Artificial Intelligence

Item-based collaborative filtering (ICF) has been widely used in industrial applications such as recommender system and online advertising. It models users' preference on target items by the items they have interacted with. Recent models use methods such as attention mechanism and deep neural network to learn the user representation and scoring function more accurately. However, despite their effectiveness, such models still overlook a problem that performance of ICF methods heavily depends on the quality of item representation especially the target item representation. In fact, due to the long-tail distribution in the recommendation, most item embeddings can not represent the semantics of items accurately and thus degrade the performance of current ICF methods. In this paper, we propose an enhanced representation of the target item which distills relevant information from the co-occurrence items. We design sampling strategies to sample fix number of co-occurrence items for the sake of noise reduction and computational cost. Considering the different importance of sampled items to the target item, we apply attention mechanism to selectively adopt the semantic information of the sampled items. Our proposed Co-occurrence based Enhanced Representation model (CER) learns the scoring function by a deep neural network with the attentive user representation and fusion of raw representation and enhanced representation of target item as input. With the enhanced representation, CER has stronger representation power for the tail items compared to the state-of-the-art ICF methods. Extensive experiments on two public benchmarks demonstrate the effectiveness of CER.


How Artificial Intelligence Can Assist Resist Coronavirus - The Tech Trend

#artificialintelligence

Imagine a normal Tuesday morning. The lot is complete, with vehicles parked nose to nose. You wait in a very long line, similar to what you'd see at Disney on a typical weekend. You move your cart about frenzied shoppers, only to find that Costco is out of face masks, nonperishable items, medications, hand sanitizers, and hand soaps. The fear and dread since the coronavirus (called'2019-nCov' or'Covid-19) spread worldwide.


Sampling Permutations for Shapley Value Estimation

arXiv.org Machine Learning

Game-theoretic attribution techniques based on Shapley values are used extensively to interpret black-box machine learning models, but their exact calculation is generally NP-hard, requiring approximation methods for non-trivial models. As the computation of Shapley values can be expressed as a summation over a set of permutations, a common approach is to sample a subset of these permutations for approximation. Unfortunately, standard Monte Carlo sampling methods can exhibit slow convergence, and more sophisticated quasi Monte Carlo methods are not well defined on the space of permutations. To address this, we investigate new approaches based on two classes of approximation methods and compare them empirically. First, we demonstrate quadrature techniques in a RKHS containing functions of permutations, using the Mallows kernel to obtain explicit convergence rates of $O(1/n)$, improving on $O(1/\sqrt{n})$ for plain Monte Carlo. The RKHS perspective also leads to quasi Monte Carlo type error bounds, with a tractable discrepancy measure defined on permutations. Second, we exploit connections between the hypersphere $\mathbb{S}^{d-2}$ and permutations to create practical algorithms for generating permutation samples with good properties. Experiments show the above techniques provide significant improvements for Shapley value estimates over existing methods, converging to a smaller RMSE in the same number of model evaluations.