Goto

Collaborating Authors

 Oceania


How Neural Processes Improve Graph Link Prediction

arXiv.org Machine Learning

Link prediction is a fundamental problem in graph data analysis. While most of the literature focuses on transductive link prediction that requires all the graph nodes and majority of links in training, inductive link prediction, which only uses a proportion of the nodes and their links in training, is a more challenging problem in various real-world applications. In this paper, we propose a meta-learning approach with graph neural networks for link prediction: Neural Processes for Graph Neural Networks (NPGNN), which can perform both transductive and inductive learning tasks and adapt to patterns in a large new graph after training with a small subgraph. Experiments on real-world graphs are conducted to validate our model, where the results suggest that the proposed method achieves stronger performance compared to other state-of-the-art models, and meanwhile generalizes well when training on a small subgraph.


Google announces redesign of Search engine with more pictures and extra context about results

The Independent - Tech

Google has announced a new redesign of its search tools, making it more visual and adding in extra contextual information about its results. At its Search On event, the web giant also announced new features for Google Chrome and its Google Lens artificially-intelligent photo software. The main aesthetic change are visually browsable results, "for searches where you need inspiration" such as "pour painting ideas", Google says, which will surface a series of pictures at the top of search results without having to navigate to the Images tab. It will also bring in more contextual information, rolled out over the coming months, with a new'Things to know" section that includes "different dimensions people typically search for". For those searching how to paint with acrylics, for example, underneath the top result will be a series of drop-down results that include a step-by-step guide, tips, or style options.


Lack of understanding of artificial intelligence and machine learning contributing to cybersecurity attacks

#artificialintelligence

While use of artificial intelligence and machine learning is high amongst IT decision makers, more than half are unsure what the technology actually means, new research has revealed. Webroot has released its annual artificial intelligence and machine learning report, which reveals how IT professionals perceive and use these advancing technologies in business. According to the research, while 93% of IT decision makers in Australia and New Zealand use artificial intelligence and machine learning, more than half (51%) admit they are unsure what the technology means. Although understanding around these tools is increasing (64% of global respondents were unsure what artificial intelligence and machine learning meant in 2020), this is happening at a significantly slower pace than the adoption rate. Webroot says this lack of understanding may be why Australia was the country where enterprises were most likely to cite struggling to keep up with the latest technology as the reason they were unable to prevent a cyberattack in the last year.


BulletTrain: Accelerating Robust Neural Network Training via Boundary Example Mining

arXiv.org Artificial Intelligence

Neural network robustness has become a central topic in machine learning in recent years. Most training algorithms that improve the model's robustness to adversarial and common corruptions also introduce a large computational overhead, requiring as many as ten times the number of forward and backward passes in order to converge. To combat this inefficiency, we propose BulletTrain $-$ a boundary example mining technique to drastically reduce the computational cost of robust training. Our key observation is that only a small fraction of examples are beneficial for improving robustness. BulletTrain dynamically predicts these important examples and optimizes robust training algorithms to focus on the important examples. We apply our technique to several existing robust training algorithms and achieve a 2.1$\times$ speed-up for TRADES and MART on CIFAR-10 and a 1.7$\times$ speed-up for AugMix on CIFAR-10-C and CIFAR-100-C without any reduction in clean and robust accuracy.


Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration

arXiv.org Artificial Intelligence

Despite Graph Neural Networks (GNNs) have achieved remarkable accuracy, whether the results are trustworthy is still unexplored. Previous studies suggest that many modern neural networks are over-confident on the predictions, however, surprisingly, we discover that GNNs are primarily in the opposite direction, i.e., GNNs are under-confident. Therefore, the confidence calibration for GNNs is highly desired. In this paper, we propose a novel trustworthy GNN model by designing a topology-aware post-hoc calibration function. Specifically, we first verify that the confidence distribution in a graph has homophily property, and this finding inspires us to design a calibration GNN model (CaGCN) to learn the calibration function. CaGCN is able to obtain a unique transformation from logits of GNNs to the calibrated confidence for each node, meanwhile, such transformation is able to preserve the order between classes, satisfying the accuracy-preserving property. Moreover, we apply the calibration GNN to self-training framework, showing that more trustworthy pseudo labels can be obtained with the calibrated confidence and further improve the performance. Extensive experiments demonstrate the effectiveness of our proposed model in terms of both calibration and accuracy.


Road Network Guided Fine-Grained Urban Traffic Flow Inference

arXiv.org Artificial Intelligence

Accurate inference of fine-grained traffic flow from coarse-grained one is an emerging yet crucial problem, which can help greatly reduce the number of traffic monitoring sensors for cost savings. In this work, we notice that traffic flow has a high correlation with road network, which was either completely ignored or simply treated as an external factor in previous works. To facilitate this problem, we propose a novel Road-Aware Traffic Flow Magnifier (RATFM) that explicitly exploits the prior knowledge of road networks to fully learn the road-aware spatial distribution of fine-grained traffic flow. Specifically, a multi-directional 1D convolutional layer is first introduced to extract the semantic feature of the road network. Subsequently, we incorporate the road network feature and coarse-grained flow feature to regularize the short-range spatial distribution modeling of road-relative traffic flow. Furthermore, we take the road network feature as a query to capture the long-range spatial distribution of traffic flow with a transformer architecture. Benefiting from the road-aware inference mechanism, our method can generate high-quality fine-grained traffic flow maps. Extensive experiments on three real-world datasets show that the proposed RATFM outperforms state-of-the-art models under various scenarios.


On the Estimation Bias in Double Q-Learning

arXiv.org Machine Learning

Double Q-learning is a classical method for reducing overestimation bias, which is caused by taking maximum estimated values in the Bellman operation. Its variants in the deep Q-learning paradigm have shown great promise in producing reliable value prediction and improving learning performance. However, as shown by prior work, double Q-learning is not fully unbiased and suffers from underestimation bias. In this paper, we show that such underestimation bias may lead to multiple non-optimal fixed points under an approximated Bellman operator. To address the concerns of converging to non-optimal stationary solutions, we propose a simple but effective approach as a partial fix for the underestimation bias in double Q-learning. This approach leverages an approximate dynamic programming to bound the target value. We extensively evaluate our proposed method in the Atari benchmark tasks and demonstrate its significant improvement over baseline algorithms.


Lack of understanding of artificial intelligence and machine learning contributing to … – SecurityBrief

#artificialintelligence

According to the research, while 93% of IT decision makers in Australia and New Zealand use artificial intelligence and machine learning, more than half (51%) …


USQ to lead national project to bridge critical health gap

#artificialintelligence

Can artificial intelligence help us understand transmissible infections better? As people the world over become accepting of testing regimes required to diagnose, monitor, and assess outbreaks of the COVID-19, researchers from the University of Southern Queensland are attempting to change the way testing for other types of transmissible infections are understood and utilised – using Artificial Intelligence (AI). A cross-disciplinary research team made up of four USQ experts and an expert colleague from The University of Queensland have been awarded a $500,000 competitive research grant from the Australian Government as part of its First National Blood Borne Viruses and Sexually Transmissible Infections Research Strategy 2021 – 2025. The grant will support the development of a mobile app, supported by AI, centred around sexual health risk behaviours, and screening and testing for Sexually Transmissible Infections, or STIs. Dr Zhaohui Tang and Professor Yan Li from USQ's School of Sciences will lead the project.


'False choice': is deep-sea mining required for an electric vehicle revolution?

The Guardian

At the Goodwood festival of speed near Chichester, the crowds gathered at the hill-climb circuit to watch the world's fastest cars roar past, as they do every year. But not far from the high-octane action, there was a new, and quieter, attraction: a display of the latest electric vehicles, from the £28,000 Mini Electric to the £2m Lotus Evija hypercar. Even here, at one of the biggest events in Britain's petrolhead calendar, it's clear the days of the internal combustion engine are numbered. As countries strive to meet stringent carbon-emission targets, and vehicle-makers phase out combustion engines, 145m electric vehicles are predicted to be on the roads within a decade, up from 11m last year. The car batteries they require, along with storage batteries for solar and wind power, have sent demand for metals soaring, taking mining firms to the bottom of the sea in the hunt for those metals.