Oceania
An Effective System for Multi-format Information Extraction
Liu, Yaduo, Zhang, Longhui, Yin, Shujuan, Zhao, Xiaofeng, Ren, Feiliang
The multi-format information extraction task in the 2021 Language and Intelligence Challenge is designed to comprehensively evaluate information extraction from different dimensions. It consists of an multiple slots relation extraction subtask and two event extraction subtasks that extract events from both sentence-level and document-level. Here we describe our system for this multi-format information extraction competition task. Specifically, for the relation extraction subtask, we convert it to a traditional triple extraction task and design a voting based method that makes full use of existing models. For the sentence-level event extraction subtask, we convert it to a NER task and use a pointer labeling based method for extraction. Furthermore, considering the annotated trigger information may be helpful for event extraction, we design an auxiliary trigger recognition model and use the multi-task learning mechanism to integrate the trigger features into the event extraction model. For the document-level event extraction subtask, we design an Encoder-Decoder based method and propose a Transformer-alike decoder. Finally,our system ranks No.4 on the test set leader-board of this multi-format information extraction task, and its F1 scores for the subtasks of relation extraction, event extractions of sentence-level and document-level are 79.887%, 85.179%, and 70.828% respectively. The codes of our model are available at {https://github.com/neukg/MultiIE}.
Blockchain-based Trustworthy Federated Learning Architecture
Lo, Sin Kit, Liu, Yue, Lu, Qinghua, Wang, Chen, Xu, Xiwei, Paik, Hye-Young, Zhu, Liming
Federated learning is an emerging privacy-preserving AI technique where clients (i.e., organisations or devices) train models locally and formulate a global model based on the local model updates without transferring local data externally. However, federated learning systems struggle to achieve trustworthiness and embody responsible AI principles. In particular, federated learning systems face accountability and fairness challenges due to multi-stakeholder involvement and heterogeneity in client data distribution. To enhance the accountability and fairness of federated learning systems, we present a blockchain-based trustworthy federated learning architecture. We first design a smart contract-based data-model provenance registry to enable accountability. Additionally, we propose a weighted fair data sampler algorithm to enhance fairness in training data. We evaluate the proposed approach using a COVID-19 X-ray detection use case. The evaluation results show that the approach is feasible to enable accountability and improve fairness. The proposed algorithm can achieve better performance than the default federated learning setting in terms of the model's generalisation and accuracy.
Responsible AI Programs To Follow And Implement-- Breakout Year 2021
Responsible usage of AI is growing extensively since 2017 and 2021 will see expansion fully into the operationalization of AI ethical principles, frameworks, and policies. Operationalization defined as taking principles into useful practice and thus requiring prioritization for businesses. The challenge is focusing on the top initiatives which I will identify in this article. In my pro bono contributions across 100 global programs with non-profits, I am seeing businesses are still challenged in moving from proof-of-concept responsible AI applications, within one business unit, to scaling across the enterprise. With more than 300 AI principles, frameworks, policy, and regulatory initiatives--businesses must keep current of the top contenders as AI usage grows.
Grant success for research on Artificial Intelligence in IVF
Congratulations to Dr Fabrizzio Horta on receiving the 2021 Monash Data Futures Institute Seed Grant - AI and Data Science for Monash Global Challenges. This $50,000 grant will help in the research collaboration between the Department of Obstetrics and Gynaecology (Dr Fabrizzio Horta, Prof Beverley Vollenhoven) and the Department of Data Science and AI (A/Prof Hamid Rezatofhigi, Prof Jianfei Cai). "This grant will help us to support our current research, aiming to develop a clinical decision support system in IVF through deep learning algorithms. Particularly this grant aims to target one of the global challenges we are facing by introducing Artificial Intelligence technology into clinical practice. Thus, it will not just have a local impact, but a global impact in the IVF field through strong international research collaboration".
Neural Architecture Dilation for Adversarial Robustness
Li, Yanxi, Yang, Zhaohui, Wang, Yunhe, Xu, Chang
With the tremendous advances in the architecture and scale of convolutional neural networks (CNNs) over the past few decades, they can easily reach or even exceed the performance of humans in certain tasks. However, a recently discovered shortcoming of CNNs is that they are vulnerable to adversarial attacks. Although the adversarial robustness of CNNs can be improved by adversarial training, there is a trade-off between standard accuracy and adversarial robustness. From the neural architecture perspective, this paper aims to improve the adversarial robustness of the backbone CNNs that have a satisfactory accuracy. Under a minimal computational overhead, the introduction of a dilation architecture is expected to be friendly with the standard performance of the backbone CNN while pursuing adversarial robustness. Theoretical analyses on the standard and adversarial error bounds naturally motivate the proposed neural architecture dilation algorithm. Experimental results on real-world datasets and benchmark neural networks demonstrate the effectiveness of the proposed algorithm to balance the accuracy and adversarial robustness.
A Fast Algorithm for Computing the Deficiency Number of a Mahjong Hand
Yan, Xueqing, Li, Yongming, Li, Sanjiang
The tile-based multiplayer game Mahjong is widely played in Asia and has also become increasingly popular worldwide. Face-to-face or online, each player begins with a hand of 13 tiles and players draw and discard tiles in turn until they complete a winning hand. An important notion in Mahjong is the deficiency number (a.k.a. shanten number in Japanese Mahjong) of a hand, which estimates how many tile changes are necessary to complete the hand into a winning hand. The deficiency number plays an essential role in major decision-making tasks such as selecting a tile to discard. This paper proposes a fast algorithm for computing the deficiency number of a Mahjong hand. Compared with the baseline algorithm, the new algorithm is usually 100 times faster and, more importantly, respects the agent's knowledge about available tiles. The algorithm can be used as a basic procedure in all Mahjong variants by both rule-based and machine learning-based Mahjong AI.
Learning from Images: Proactive Caching with Parallel Convolutional Neural Networks
Wang, Yantong, Hu, Ye, Yang, Zhaohui, Saad, Walid, Wong, Kai-Kit, Friderikos, Vasilis
With the continuous trend of data explosion, delivering packets from data servers to end users causes increased stress on both the fronthaul and backhaul traffic of mobile networks. To mitigate this problem, caching popular content closer to the end-users has emerged as an effective method for reducing network congestion and improving user experience. To find the optimal locations for content caching, many conventional approaches construct various mixed integer linear programming (MILP) models. However, such methods may fail to support online decision making due to the inherent curse of dimensionality. In this paper, a novel framework for proactive caching is proposed. This framework merges model-based optimization with data-driven techniques by transforming an optimization problem into a grayscale image. For parallel training and simple design purposes, the proposed MILP model is first decomposed into a number of sub-problems and, then, convolutional neural networks (CNNs) are trained to predict content caching locations of these sub-problems. Furthermore, since the MILP model decomposition neglects the internal effects among sub-problems, the CNNs' outputs have the risk to be infeasible solutions. Therefore, two algorithms are provided: the first uses predictions from CNNs as an extra constraint to reduce the number of decision variables; the second employs CNNs' outputs to accelerate local search. Numerical results show that the proposed scheme can reduce 71.6% computation time with only 0.8% additional performance cost compared to the MILP solution, which provides high quality decision making in real-time.
Deep Geospatial Interpolation Networks
Varshney, Sumit Kumar, Kumar, Jeetu, Tiwari, Aditya, Singh, Rishabh, Gunturi, Venkata M. V., Krishnan, Narayanan C.
To this end, we propose a novel deep neural network called as Research literature relevant to our work consists of the work done Deep Geospatial Interpolation Network(DGIN), which incorporates in the areas of traditional spatial statistics [1, 7, 9, 10], spatial data both spatial and temporal relationships and has significantly lower mining [4, 8], neural networks for spatio-temporal data [3, 11], and training time. DGIN consists of three major components: Spatial computer vision [5, 6]. Encoder to capture the spatial dependencies, Sequential module Spatial statistics techniques such as IDW [9], DDW [10], Kriging to incorporate the temporal dynamics, and an Attention block to [1, 7], and its variants are not suitable for the interpolation learn the importance of the temporal neighborhood around the problem because of the following reasons: (a) high execution time gap. We evaluate DGIN on the MODIS reflectance dataset from (in case of Kriging), (b) strong assumptions on the nature of spatial two different regions. Our experimental results indicate that DGIN relationships (such as inverse relationship in case of IDW), (c) has two advantages: (a) it outperforms alternative approaches (has prior assumption and/or knowledge on statistical properties of data lower MSE with p-value 0.01) and, (b) it has significantly low (e.g., precise knowledge of the mean in case of Simple Kriging and execution time than Kriging.
The Price of Selfishness: Conjunctive Query Entailment for ALCSelf is 2ExpTime-hard
Bednarczyk, Bartosz, Rudolph, Sebastian
In logic-based knowledge representation, query answering has essentially replaced mere satisfiability checking as the inferencing problem of primary interest. For knowledge bases in the basic description logic ALC, the computational complexity of conjunctive query (CQ) answering is well known to be ExpTime-complete and hence not harder than satisfiability. This does not change when the logic is extended by certain features (such as counting or role hierarchies), whereas adding others (inverses, nominals or transitivity together with role-hierarchies) turns CQ answering exponentially harder. We contribute to this line of results by showing the surprising fact that even extending ALC by just the Self operator - which proved innocuous in many other contexts - increases the complexity of CQ entailment to 2ExpTime. As common for this type of problem, our proof establishes a reduction from alternating Turing machines running in exponential space, but several novel ideas and encoding tricks are required to make the approach work in that specific, restricted setting.
The Impact of Covid-19 on Digital Acceleration & Adoption of AI
It was reported that Venture Capital investments into AI related startups made a significant increase in 2018, jumping by 72% compared to 2017, with 466 startups funded from 533 in 2017. PWC moneytree report stated that that seed-stage deal activity in the US among AI-related companies rose to 28% in the fourth-quarter of 2018, compared to 24% in the three months prior, while expansion-stage deal activity jumped to 32%, from 23%. There will be an increasing international rivalry over the global leadership of AI. President Putin of Russia was quoted as saying that "the nation that leads in AI will be the ruler of the world". Billionaire Mark Cuban was reported in CNBC as stating that "the world's first trillionaire would be an AI entrepreneur".