Goto

Collaborating Authors

 Oceania


Gaussian Processes on Hypergraphs

arXiv.org Machine Learning

We derive a Matern Gaussian process (GP) on the vertices of a hypergraph. This enables estimation of regression models of observed or latent values associated with the vertices, in which the correlation and uncertainty estimates are informed by the hypergraph structure. We further present a framework for embedding the vertices of a hypergraph into a latent space using the hypergraph GP. Finally, we provide a scheme for identifying a small number of representative inducing vertices that enables scalable inference through sparse GPs. We demonstrate the utility of our framework on three challenging real-world problems that concern multi-class classification for the political party affiliation of legislators on the basis of voting behaviour, probabilistic matrix factorisation of movie reviews, and embedding a hypergraph of animals into a low-dimensional latent space.


Beware the Privacy Violations in Artificial Intelligence Applications

#artificialintelligence

It has been proposed that, "Privacy matters to the electorate, and smart business looks at how to use data to find out information while remaining in compliance with regulatory rules." Since "smart business" also consists of "the electorate" as employees, at least one burning question is whether privacy or ethical violations in technologies like artificial intelligence (AI) will really matter sufficiently to employees who may be more concerned about putting food on the table than about raising concerns or performing whistleblowing, with potentially negative job consequences for them? And what happens if the country, region, or sector is too immature to have meaningful regulatory rules to comply with? Does it then become a case of almost anything goes? After all, no laws will be broken by the "smart business" in this case.


2030 percent of the vehicles to be sold in the world in 50 will be electric

#artificialintelligence

As of the end of 2020, 78 million motor vehicles were produced in the world, of which 4,2% was electric vehicles. For example, when we look at the European market, the share of electric vehicles is growing rapidly, and over 1 million electric vehicles were sold in Europe last year. In 2020, electric vehicle sales in Germany reached 254 thousand, an increase of 398% compared to the previous year. Germany has become the largest market in the world after China. Explaining that these data herald the demand for electric vehicles, TTT Global Group Chairman of the Board Dr. Akın Arslan said: "These rates are a sign that electric vehicles are at a very important threshold in the world. According to Morgan Stanley analysis, the global electric vehicle market is expected to grow by 2021% in 50. In 2030, it is predicted that 50% of the vehicles sold in the world will be electric vehicles and the rate of electric vehicles on the roads will exceed 31%. Noting that Tesla is worth more than the 700 most valuable automobile manufacturers in the world with a value of approximately 7 billion dollars, TTT Global Group President Dr. Akın Arslan said: "Tesla, which started mass production in 2012 with its 9% electric vehicle Tesla S, reached a value more than three times the world's most valuable automobile company Toyota in 2021 years.


Productivity booster: Betting big on Artificial Intelligence

#artificialintelligence

The goal of any business is to improve productivity, enhance the customer experience, and maximise profits--Artificial Intelligence (AI) can play a crucial role on all these fronts, says Ramprakash Ramamoorthy, director of research at ManageEngine, the enterprise IT management division of Chennai-based business software maker Zoho. "The enormous growth witnessed in cloud computing has resulted in a huge amount of generated data. This is where AI steps in. Utilising AI to analyse vast amounts of collected data helps businesses gain a deep understanding of their systems," he says. Ramamoorthy stresses that when deployed correctly, AI systems can predict outages, help provide proactive infrastructure management and ensure better service availability.


Teaching Machine Learning in K-12 Computing Education: Potential and Pitfalls

arXiv.org Artificial Intelligence

Over the past decades, numerous practical applications of machine learning techniques have shown the potential of data-driven approaches in a large number of computing fields. Machine learning is increasingly included in computing curricula in higher education, and a quickly growing number of initiatives are expanding it in K-12 computing education, too. As machine learning enters K-12 computing education, understanding how intuition and agency in the context of such systems is developed becomes a key research area. But as schools and teachers are already struggling with integrating traditional computational thinking and traditional artificial intelligence into school curricula, understanding the challenges behind teaching machine learning in K-12 is an even more daunting challenge for computing education research. Despite the central position of machine learning in the field of modern computing, the computing education research body of literature contains remarkably few studies of how people learn to train, test, improve, and deploy machine learning systems. This is especially true of the K-12 curriculum space. This article charts the emerging trajectories in educational practice, theory, and technology related to teaching machine learning in K-12 education. The article situates the existing work in the context of computing education in general, and describes some differences that K-12 computing educators should take into account when facing this challenge. The article focuses on key aspects of the paradigm shift that will be required in order to successfully integrate machine learning into the broader K-12 computing curricula. A crucial step is abandoning the belief that rule-based "traditional" programming is a central aspect and building block in developing next generation computational thinking.


Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

arXiv.org Artificial Intelligence

Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, and (2) composing a cohesive text by reconstructing these salient facts into a shorter summary that faithfully reflects the complex relations connecting these facts. In this paper, we adapt TP-TRANSFORMER (Schlag et al., 2019), an architecture that enriches the original Transformer (Vaswani et al., 2017) with the explicitly compositional Tensor Product Representation (TPR), for the task of abstractive summarization. The key feature of our model is a structural bias that we introduce by encoding two separate representations for each token to represent the syntactic structure (with role vectors) and semantic content (with filler vectors) separately. The model then binds the role and filler vectors into the TPR as the layer output. We argue that the structured intermediate representations enable the model to take better control of the contents (salient facts) and structures (the syntax that connects the facts) when generating the summary. Empirically, we show that our TP-TRANSFORMER outperforms the Transformer and the original TP-TRANSFORMER significantly on several abstractive summarization datasets based on both automatic and human evaluations. On several syntactic and semantic probing tasks, we demonstrate the emergent structural information in the role vectors and improved syntactic interpretability in the TPR layer outputs. Code and models are available at https://github.com/jiangycTarheel/TPT-Summ.


Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification

arXiv.org Artificial Intelligence

Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore the semantic interaction between the claim and evidence at different granularity levels but fail to capture their topical consistency during the reasoning process, which we believe is crucial for verification; (ii) aggregate multiple pieces of evidence equally without considering their implicit stances to the claim, thereby introducing spurious information. To alleviate the above issues, we propose a novel topic-aware evidence reasoning and stance-aware aggregation model for more accurate fact verification, with the following four key properties: 1) checking topical consistency between the claim and evidence; 2) maintaining topical coherence among multiple pieces of evidence; 3) ensuring semantic similarity between the global topic information and the semantic representation of evidence; 4) aggregating evidence based on their implicit stances to the claim. Extensive experiments conducted on the two benchmark datasets demonstrate the superiority of the proposed model over several state-of-the-art approaches for fact verification. The source code can be obtained from https://github.com/jasenchn/TARSA.


Conversational Question Answering: A Survey

arXiv.org Artificial Intelligence

Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of conversational artificial intelligence (AI) which has led to the introduction of a special research topic on Conversational Question Answering (CQA), wherein a system is required to understand the given context and then engages in multi-turn QA to satisfy the user's information needs. Whilst the focus of most of the existing research work is subjected to single-turn QA, the field of multi-turn QA has recently grasped attention and prominence owing to the availability of large-scale, multi-turn QA datasets and the development of pre-trained language models. With a good amount of models and research papers adding to the literature every year recently, there is a dire need of arranging and presenting the related work in a unified manner to streamline future research. This survey, therefore, is an effort to present a comprehensive review of the state-of-the-art research trends of CQA primarily based on reviewed papers from 2016-2021. Our findings show that there has been a trend shift from single-turn to multi-turn QA which empowers the field of Conversational AI from different perspectives. This survey is intended to provide an epitome for the research community with the hope of laying a strong foundation for the field of CQA.


Few-NERD: A Few-Shot Named Entity Recognition Dataset

arXiv.org Artificial Intelligence

Recently, considerable literature has grown up around the theme of few-shot named entity recognition (NER), but little published benchmark data specifically focused on the practical and challenging task. Current approaches collect existing supervised NER datasets and re-organize them to the few-shot setting for empirical study. These strategies conventionally aim to recognize coarse-grained entity types with few examples, while in practice, most unseen entity types are fine-grained. In this paper, we present Few-NERD, a large-scale human-annotated few-shot NER dataset with a hierarchy of 8 coarse-grained and 66 fine-grained entity types. Few-NERD consists of 188,238 sentences from Wikipedia, 4,601,160 words are included and each is annotated as context or a part of a two-level entity type. To the best of our knowledge, this is the first few-shot NER dataset and the largest human-crafted NER dataset. We construct benchmark tasks with different emphases to comprehensively assess the generalization capability of models. Extensive empirical results and analysis show that Few-NERD is challenging and the problem requires further research. We make Few-NERD public at https://ningding97.github.io/fewnerd/.


Knowing More About Questions Can Help: Improving Calibration in Question Answering

arXiv.org Artificial Intelligence

We study calibration in question answering, estimating whether model correctly predicts answer for each question. Unlike prior work which mainly rely on the model's confidence score, our calibrator incorporates information about the input example (e.g., question and the evidence context). Together with data augmentation via back translation, our simple approach achieves 5-10% gains in calibration accuracy on reading comprehension benchmarks. Furthermore, we present the first calibration study in the open retrieval setting, comparing the calibration accuracy of retrieval-based span prediction models and answer generation models. Here again, our approach shows consistent gains over calibrators relying on the model confidence. Our simple and efficient calibrator can be easily adapted to many tasks and model architectures, showing robust gains in all settings.