Goto

Collaborating Authors

 Oceania


25 Industries & Technologies That Will Shape The Post-Virus World

#artificialintelligence

In industries from healthcare to education to finance to manufacturing, quarantine and extended work-from-home forced companies to use technology to reimagine nearly every facet of their operations. As the world reopens in fits and starts, we analyze the industries poised to thrive in a post-Covid world. As the Covid-19 pandemic has charted its unprecedented path around the world, it's carried with it the question: What will Covid-19's legacy be? From healthcare to education to entertainment to manufacturing, technology innovators are stepping forward to help answer that question. "Crisis can be… a catalyst or can speed up changes that are on the way -- it almost can serve as an accelerant." In the wake of the outbreak, everything from doctors appointments to schooling to workouts went online. As more people have worked, learned, banked, exercised, relaxed, and even sought medical care from home during Covid-19, they have gotten a crash course in just how much can be accomplished at ...


AI as a Service (AIaaS) Market will Touch USD 43.29 Billion at a Whopping 25.8% CAGR by 2030- Report by Market Research Future (MRFR)

#artificialintelligence

New York, US, Jan. 31, 2022 (GLOBE NEWSWIRE) -- Market Overview: According to a comprehensive research report by Market Research Future (MRFR), "AI as a Service Market information by Technology, by Vertical and Region – forecast to 2030" market size to reach USD 43.29 billion, growing at a compound annual growth rate of 25.8% by 2030. AIaaS Market Scope: The increasing expenditure to adopt AI and advances in technology for workflow optimization will offer robust opportunities for the AlaaS market over the forecast period. Besides, the increasing adoption of cloud-based solutions in different end user industries & increasing need for cognitive computing will also fuel market growth. Besides, the other factors adding market growth include the increasing use of social media platforms, increase in the number of start-ups, and increasing demand for artificial intelligence enabled SDK's and APIs. Market USP Exclusively Encompassed: AIaaS Market Drivers Growing Need for AI and Cognitive Computing to Boost Market Growth The growing need for artificial intelligence and cognitive computing & the large-scale use of cloud-based solutions for intelligent business applications will boost market growth over the forecast period.


Correcting diacritics and typos with ByT5 transformer model

arXiv.org Machine Learning

Due to the fast pace of life and online communications, the prevalence of English and the QWERTY keyboard, people tend to forgo using diacritics, make typographical errors (typos) when typing. Restoring diacritics and correcting spelling is important for proper language use and disambiguation of texts for both humans and downstream algorithms. However, both of these problems are typically addressed separately, i.e., state-of-the-art diacritics restoration methods do not tolerate other typos. In this work, we tackle both problems at once by employing newly-developed ByT5 byte-level transformer models. Our simultaneous diacritics restoration and typos correction approach demonstrates near state-of-the-art performance in 13 languages, reaching >96% of the alpha-word accuracy. We also perform diacritics restoration alone on 12 benchmark datasets with the additional one for the Lithuanian language. The experimental investigation proves that our approach is able to achieve comparable results (>98%) to previously reported despite being trained on fewer data. Our approach is also able to restore diacritics in words not seen during training with >76% accuracy. We also show the accuracies to further improve with longer training. All this shows a great real-world application potential of our suggested methods to more data, languages, and error classes.


Neural Character-Level Syntactic Parsing for Chinese

Journal of Artificial Intelligence Research

In this work, we explore character-level neural syntactic parsing for Chinese with two typical syntactic formalisms: the constituent formalism and a dependency formalism based on a newly released character-level dependency treebank. Prior works in Chinese parsing have struggled with whether to de ne words when modeling character interactions. We choose to integrate full character-level syntactic dependency relationships using neural representations from character embeddings and richer linguistic syntactic information from human-annotated character-level Parts-Of-Speech and dependency labels. This has the potential to better understand the deeper structure of Chinese sentences and provides a better structural formalism for avoiding unnecessary structural ambiguities. Specifically, we  first compare two different character-level syntax annotation styles: constituency and dependency. Then, we discuss two key problems for character-level parsing: (1) how to combine constituent and dependency syntactic structure in full character-level trees and (2) how to convert from character-level to word-level for both constituent and dependency trees. In addition, we also explore several other key parsing aspects, including di erent character-level dependency annotations and joint learning of Parts-Of-Speech and syntactic parsing. Finally, we evaluate our models on the Chinese Penn Treebank (CTB) and our published Shanghai Jiao Tong University Chinese Character Dependency Treebank (SCDT). The results show the e effectiveness of our model on both constituent and dependency parsing. We further provide empirical analysis and suggest several directions for future study.


Generalization in Cooperative Multi-Agent Systems

arXiv.org Artificial Intelligence

Collective intelligence is a fundamental trait shared by several species of living organisms. It has allowed them to thrive in the diverse environmental conditions that exist on our planet. From simple organisations in an ant colony to complex systems in human groups, collective intelligence is vital for solving complex survival tasks. As is commonly observed, such natural systems are flexible to changes in their structure. Specifically, they exhibit a high degree of generalization when the abilities or the total number of agents changes within a system. We term this phenomenon as Combinatorial Generalization (CG). CG is a highly desirable trait for autonomous systems as it can increase their utility and deployability across a wide range of applications. While recent works addressing specific aspects of CG have shown impressive results on complex domains, they provide no performance guarantees when generalizing towards novel situations. In this work, we shed light on the theoretical underpinnings of CG for cooperative multi-agent systems (MAS). Specifically, we study generalization bounds under a linear dependence of the underlying dynamics on the agent capabilities, which can be seen as a generalization of Successor Features to MAS. We then extend the results first for Lipschitz and then arbitrary dependence of rewards on team capabilities. Finally, empirical analysis on various domains using the framework of multi-agent reinforcement learning highlights important desiderata for multi-agent algorithms towards ensuring CG.


MEGA: Model Stealing via Collaborative Generator-Substitute Networks

arXiv.org Artificial Intelligence

Deep machine learning models are increasingly deployedin the wild for providing services to users. Adversaries maysteal the knowledge of these valuable models by trainingsubstitute models according to the inference results of thetargeted deployed models. Recent data-free model stealingmethods are shown effective to extract the knowledge of thetarget model without using real query examples, but they as-sume rich inference information, e.g., class probabilities andlogits. However, they are all based on competing generator-substitute networks and hence encounter training instability.In this paper we propose a data-free model stealing frame-work,MEGA, which is based on collaborative generator-substitute networks and only requires the target model toprovide label prediction for synthetic query examples. Thecore of our method is a model stealing optimization con-sisting of two collaborative models (i) the substitute modelwhich imitates the target model through the synthetic queryexamples and their inferred labels and (ii) the generatorwhich synthesizes images such that the confidence of thesubstitute model over each query example is maximized. Wepropose a novel coordinate descent training procedure andanalyze its convergence. We also empirically evaluate thetrained substitute model on three datasets and its applicationon black-box adversarial attacks. Our results show that theaccuracy of our trained substitute model and the adversarialattack success rate over it can be up to 33% and 40% higherthan state-of-the-art data-free black-box attacks.


Corpus for Automatic Structuring of Legal Documents

arXiv.org Artificial Intelligence

In populous countries, pending legal cases have been growing exponentially. There is a need for developing techniques for processing and organizing legal documents. In this paper, we introduce a new corpus for structuring legal documents. In particular, we introduce a corpus of legal judgment documents in English that are segmented into topical and coherent parts. Each of these parts is annotated with a label coming from a list of pre-defined Rhetorical Roles. We develop baseline models for automatically predicting rhetorical roles in a legal document based on the annotated corpus. Further, we show the application of rhetorical roles to improve performance on the tasks of summarization and legal judgment prediction. We release the corpus and baseline model code along with the paper.


UNESCO AI Ethics Impacting 2022 Global Startups And Humanity's Billions

#artificialintelligence

AI influences nearly 8 billion people and human & earth diverse ecosystems on an unprecedented scale. Startups accelerate to incorporate AI innovation as AI tools proliferate. UNESCO is the United Nations Educational, Scientific and Cultural Organization. The UNESCO recommendations on the ethics of AI recently adopted by member states provides a foundational global agreement on AI Ethics. The objectives ultimately drive emerging AI driven technologies that are trustworthy, safe, human-centered for the benefit of people and humanity.


UncertaintyFuseNet: Robust Uncertainty-aware Hierarchical Feature Fusion Model with Ensemble Monte Carlo Dropout for COVID-19 Detection

arXiv.org Artificial Intelligence

Abstract--The COVID-19 (Coronavirus disease 2019) pandemic Index Terms--COVID-19, Deep learning, Early fusion, Feature has become a major global threat to human health and fusion, Uncertainty quantification. Such automatic systems are usually based on traditional machine learning or deep learning methods. We argue that the uncertainty of the model's predictions PCR has a low sensitivity. H.K. Lam is with the Centre for Robotics Research, Department of F. Karray is with the Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of S. Hussain is with the System Administrator, Dibrugarh University, U. R. Acharya is with the Department of Electronics and Computer V. Makarenkov is with the Department of Computer Science, In recent years, deep learning models have had the Its areas of research and application have been growing widespread applicability not only in medical imaging field drastically. These models have allowed the information fusion to change from centralized also been extensively applied for COVID-19 detection. It is single node information fusion to distributed information critical to discriminate COVID-19 from other forms of pneumonia fusion. Farooq et al. [8] introduced an open-access Modern medicine nowadays depends on amalgamation dataset and the open-source code of their implementation of data and information from manifold sources that include using a CNN framework for distinguishing COVID-19 from structured imaging data, laboratory data, unstructured analogous pneumonia cohorts from chest X-ray images. The narrative data, and even observational or audio authors designed their COVIDResNet model by utilizing a data in some cases [22].


Fast Monte-Carlo Approximation of the Attention Mechanism

arXiv.org Artificial Intelligence

We introduce Monte-Carlo Attention (MCA), a randomized approximation method for reducing the computational cost of self-attention mechanisms in Transformer architectures. MCA exploits the fact that the importance of each token in an input sequence varies with respect to their attention scores; thus, some degree of error can be tolerable when encoding tokens with low attention. Using approximate matrix multiplication, MCA applies different error bounds to encode input tokens such that those with low attention scores are computed with relaxed precision, whereas errors of salient elements are minimized. MCA can operate in parallel with other attention optimization schemes and does not require model modification. We study the theoretical error bounds and demonstrate that MCA reduces attention complexity (in FLOPS) for various Transformer models by up to 11$\times$ in GLUE benchmarks without compromising model accuracy.