Goto

Collaborating Authors

 Oceania


Bayesian Neural Network Inference via Implicit Models and the Posterior Predictive Distribution

arXiv.org Artificial Intelligence

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than Variational Inference, and it does not rely on adversarial training (or density ratio estimation). We adopt the recent approach of constructing two models: (1) a primary model, tasked with performing regression or classification; and (2) a secondary, expressive (e.g. implicit) model that defines an approximate posterior distribution over the parameters of the primary model. However, we optimise the parameters of the posterior model via gradient descent according to a Monte Carlo estimate of the posterior predictive distribution -- which is our only approximation (other than the posterior model). Only a likelihood needs to be specified, which can take various forms such as loss functions and synthetic likelihoods, thus providing a form of a likelihood-free approach. Furthermore, we formulate the approach such that the posterior samples can either be independent of, or conditionally dependent upon the inputs to the primary model. The latter approach is shown to be capable of increasing the apparent complexity of the primary model. We see this being useful in applications such as surrogate and physics-based models. To promote how the Bayesian paradigm offers more than just uncertainty quantification, we demonstrate: uncertainty quantification, multi-modality, as well as an application with a recent deep forecasting neural network architecture.


Multi-Figurative Language Generation

arXiv.org Artificial Intelligence

Figurative language generation is the task of reformulating a given text in the desired figure of speech while still being faithful to the original context. We take the first step towards multi-figurative language modelling by providing a benchmark for the automatic generation of five common figurative forms in English. We train mFLAG employing a scheme for multi-figurative language pre-training on top of BART, and a mechanism for injecting the target figurative information into the encoder; this enables the generation of text with the target figurative form from another figurative form without parallel figurative-figurative sentence pairs. Our approach outperforms all strong baselines. We also offer some qualitative analysis and reflections on the relationship between the different figures of speech.


Impact analysis of recovery cases due to COVID19 using LSTM deep learning model

arXiv.org Artificial Intelligence

The present world is badly affected by novel coronavirus (COVID-19). Using medical kits to identify the coronavirus affected persons are very slow. What happens in the next, nobody knows. The world is facing erratic problem and do not know what will happen in near future. This paper is trying to make prognosis of the coronavirus recovery cases using LSTM (Long Short Term Memory). This work exploited data of 258 regions, their latitude and longitude and the number of death of 403 days ranging from 22-01-2020 to 27-02-2021. Specifically, advanced deep learning-based algorithms known as the LSTM, play a great effect on extracting highly essential features for time series data (TSD) analysis.There are lots of methods which already use to analyze propagation prediction. The main task of this paper culminates in analyzing the spreading of Coronavirus across worldwide recovery cases using LSTM deep learning-based architectures.


text2sdg: An R package to Monitor Sustainable Development Goals from Text

arXiv.org Artificial Intelligence

The United Nations Sustainable Development Goals (SDGs) have become an important guideline for both governmental and non-governmental organizations to monitor and plan their contributions to social, economic, and environmental transformations. The 17 SDGs cover large areas of application, from ending poverty and improving health, to fostering economic growth and preserving natural resources. As the latest UN report (UN, 2022) attests, the availability of high-quality data is still lacking in many of these areas and progress is needed in identifying data sources that can help monitor work on these goals. Monitoring of SDGs has typically been based on economic and health data (e.g.,


Identifying a Training-Set Attack's Target Using Renormalized Influence Estimation

arXiv.org Artificial Intelligence

Targeted training-set attacks inject malicious instances into the training set to cause a trained model to mislabel one or more specific test instances. This work proposes the task of target identification, which determines whether a specific test instance is the target of a training-set attack. Target identification can be combined with adversarial-instance identification to find (and remove) the attack instances, mitigating the attack with minimal impact on other predictions. Rather than focusing on a single attack method or data modality, we build on influence estimation, which quantifies each training instance's contribution to a model's prediction. We show that existing influence estimators' poor practical performance often derives from their over-reliance on training instances and iterations with large losses. Our renormalized influence estimators fix this weakness; they far outperform the original estimators at identifying influential groups of training examples in both adversarial and non-adversarial settings, even finding up to 100% of adversarial training instances with no clean-data false positives. Target identification then simplifies to detecting test instances with anomalous influence values. We demonstrate our method's effectiveness on backdoor and poisoning attacks across various data domains, including text, vision, and speech, as well as against a gray-box, adaptive attacker that specifically optimizes the adversarial instances to evade our method. Our source code is available at https://github.com/ZaydH/target_identification.


Transformer-Based Language Models for Software Vulnerability Detection

arXiv.org Artificial Intelligence

The large transformer-based language models demonstrate excellent performance in natural language processing. By considering the transferability of the knowledge gained by these models in one domain to other related domains, and the closeness of natural languages to high-level programming languages, such as C/C++, this work studies how to leverage (large) transformer-based language models in detecting software vulnerabilities and how good are these models for vulnerability detection tasks. In this regard, firstly, a systematic (cohesive) framework that details source code translation, model preparation, and inference is presented. Then, an empirical analysis is performed with software vulnerability datasets with C/C++ source codes having multiple vulnerabilities corresponding to the library function call, pointer usage, array usage, and arithmetic expression. Our empirical results demonstrate the good performance of the language models in vulnerability detection. Moreover, these language models have better performance metrics, such as F1-score, than the contemporary models, namely bidirectional long short-term memory and bidirectional gated recurrent unit. Experimenting with the language models is always challenging due to the requirement of computing resources, platforms, libraries, and dependencies. Thus, this paper also analyses the popular platforms to efficiently fine-tune these models and present recommendations while choosing the platforms.


Opportunities for Data Science Innovation in the Policing Sector

#artificialintelligence

According to Peter K. Manning, in Anglo-American societies, the purpose of the police is to "sustain politically defined order and ordering via tracking, surveillance, coercion and arrest" (2014: p.6). Consisting of several authoritatively coordinated and legitimate organizations (ibid.), the policing sector serves governments in protecting their communities, preventing crime and disorder, and ensuring justice (The Policy Circle, 2022). The police's position as acting in the communities' interest suggests that their functions are heavily dependent on public trust and societal consensus concerning social justice and fairness (Manning, 2014). While there are large numbers of police officers employed in Australia (67,200 in 2021), a number which is expected to increase in the future (Australian Industry and Skills Committee, 2022), Ransley & Mazerolle (2009) have argued that trends in public governance and regulation have caused the increased pluralization and privatisation of policing efforts. Nowadays, the policing sector thus constitutes a large network of private, public and welfare organizations geared at controlling and preventing crimes (ibid.). In this essay, I will thus focus on data science opportunities for a variety of stakeholders involved in ensuring public security and order.


How 'Lord of the Rings' Used AI to Change Big-Screen Battles Forever

#artificialintelligence

An invading force, 10,000 strong, marches through a storm toward a fortress built into the side of a mountain. From a distance, the combatants look like ants -- menacing and alarmingly well organized. They rattle their spears and snarl through teeth that have never known modern dentistry, and when lightning strikes, it reveals their sheer numbers. Volleys of arrows fly, swords find their way to the weak spots around breast plates. Bodies on both sides hit the ground. This bloody affair is the Battle of Helm's Deep, from The Lord of the Rings: The Two Towers.


The super-rich 'preppers' planning to save themselves from the apocalypse

The Guardian

As a humanist who writes about the impact of digital technology on our lives, I am often mistaken for a futurist. The people most interested in hiring me for my opinions about technology are usually less concerned with building tools that help people live better lives in the present than they are in identifying the Next Big Thing through which to dominate them in the future. I don't usually respond to their inquiries. Why help these guys ruin what's left of the internet, much less civilisation? Still, sometimes a combination of morbid curiosity and cold hard cash is enough to get me on a stage in front of the tech elite, where I try to talk some sense into them about how their businesses are affecting our lives out here in the real world. That's how I found myself accepting an invitation to address a group mysteriously described as "ultra-wealthy stakeholders", out in the middle of the desert. A limo was waiting for me at the airport.


Flinders University Is Testing a Driverless Shuttle Bus On Campus

#artificialintelligence

An autonomous shuttle bus is currently being tested at Flinders University and has now entered the second stage of its trial. Dubbed the "Flinders University Express Shuttle" (FLEX), the bus can carry 11 seated passengers. It operates on a 2.8km route and is described as a "test bed" for the future of autonomous vehicles in South Australia. In what continues to be one of Australia's only public autonomous vehicle testing programs, the Flinders University autonomous shuttle bus travels around the Tonsely innovation district, between the train station, the residential village, the university and the TAFE. It's a walking distance route, but keep in mind that it's only a trial at the moment.