Goto

Collaborating Authors

 Oceania


Towards Adversarially Robust and Domain Generalizable Stereo Matching by Rethinking DNN Feature Backbones

arXiv.org Artificial Intelligence

Stereo matching has recently witnessed remarkable progress using Deep Neural Networks (DNNs). But, how robust are they? Although it has been well-known that DNNs often suffer from adversarial vulnerability with a catastrophic drop in performance, the situation is even worse in stereo matching. This paper first shows that a type of weak white-box attacks can fail state-of-the-art methods. The attack is learned by a proposed stereo-constrained projected gradient descent (PGD) method in stereo matching. This observation raises serious concerns for the deployment of DNN-based stereo matching. Parallel to the adversarial vulnerability, DNN-based stereo matching is typically trained under the so-called simulation to reality pipeline, and thus domain generalizability is an important problem. This paper proposes to rethink the learnable DNN-based feature backbone towards adversarially-robust and domain generalizable stereo matching, either by completely removing it or by applying it only to the left reference image. It computes the matching cost volume using the classic multi-scale census transform (i.e., local binary pattern) of the raw input stereo images, followed by a stacked Hourglass head sub-network solving the matching problem. In experiments, the proposed method is tested in the SceneFlow dataset and the KITTI2015 benchmark. It significantly improves the adversarial robustness, while retaining accuracy performance comparable to state-of-the-art methods. It also shows better generalizability from simulation (SceneFlow) to real (KITTI) datasets when no fine-tuning is used.


Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition

arXiv.org Artificial Intelligence

Imagine telling your chatbot that your dog just died. Instead In this work, we introduce Knowledge-Embedded Attention of correctly understanding that you are experiencing grief (and (KEA), a knowledge-augmented attention mechanism that offering condolences), it classifies you as feeling sad and offers enriches the contextual representation provided by pre-trained to play you a happy song to cheer you up. People experience language models using emotional information obtained from a wide range of emotions, and it is important for AI agents external knowledge sources. This is achieved by incorporating to correctly recognize subtle differences between emotions the encoded emotional knowledge with the contextual representations like sadness and grief, in order to improve their interactions to form a modified key matrix. This key matrix with people and to avoid making a faux pas like the chatbot is then used to attend to the contextual representations to above [1]. Traditionally, the vast majority of work in emotion construct a more emotionally-aware representation of the input recognition from text focuses on recognizing just six "basic" text that can be used to recognise emotions. We introduce two emotions [2], [3], usually happiness, surprise, sadness, anger, variants of KEA, (i) a word-level KEA and (ii) a sentencelevel disgust, and fear. This set clearly fails to capture the broad KEA, which incorporate knowledge at different text spectrum of emotions that people experience and express in granularities.


I'm sorry Dave I'm afraid I invented that: Australian court finds AI systems can be recognised under patent law

The Guardian

An artificial intelligence system is capable of being an "inventor" under Australian patent law, the federal court has ruled, in a decision that could have wider intellectual property implications. University of Surrey professor Ryan Abbott has launched more than a dozen patent applications across the globe, including in the UK, US, New Zealand and Australia, on behalf of US-based Dr Stephen Thaler. They seek to have Thaler's artificial intelligence device known as Dabus (a device for the autonomous bootstrapping of unified sentience) listed as the inventor. The applications claimed Dabus, which is made up of artificial neural networks, invented an emergency warning light and a type of food container, among other inventions. Several countries, including Australia, had rejected the applications, stating a human must be named the inventor.


The best consultancy for business, with sales and marketing data insights too: we review

#artificialintelligence

With digital marketing, good, clean, and insightful data is a key pillar which a business stands to drive growth and profits. Having clear and precise data-driven outcomes should be a priority for all marketers. When used in tandem with well-defined marketing and sales goals, and various marketing tools and techniques, companies will discover that their lead to sale conversion process can be far less cumbersome and more rewarding. Possessing clean data will help marketers identify detailed segments based on user attributes, past behaviours, interactions, and other necessary data points. Data can be leveraged for highly targeted campaigns which will drive marketing return on investment (ROI).


Active Learning in Gaussian Process State Space Model

arXiv.org Artificial Intelligence

We investigate active learning in Gaussian Process state-space models (GPSSM). Our problem is to actively steer the system through latent states by determining its inputs such that the underlying dynamics can be optimally learned by a GPSSM. In order that the most informative inputs are selected, we employ mutual information as our active learning criterion. In particular, we present two approaches for the approximation of mutual information for the GPSSM given latent states. The proposed approaches are evaluated in several physical systems where we actively learn the underlying non-linear dynamics represented by the state-space model.


Towards Continual Entity Learning in Language Models for Conversational Agents

arXiv.org Artificial Intelligence

Neural language models (LM) trained on diverse corpora are known to work well on previously seen entities, however, updating these models with dynamically changing entities such as place names, song titles and shopping items requires re-training from scratch and collecting full sentences containing these entities. We aim to address this issue, by introducing entity-aware language models (EALM), where we integrate entity models trained on catalogues of entities into the pre-trained LMs. Our combined language model adaptively adds information from the entity models into the pre-trained LM depending on the sentence context. Our entity models can be updated independently of the pre-trained LM, enabling us to influence the distribution of entities output by the final LM, without any further training of the pre-trained LM. We show significant perplexity improvements on task-oriented dialogue datasets, especially on long-tailed utterances, with an ability to continually adapt to new entities (to an extent).


Refining Labelled Systems for Modal and Constructive Logics with Applications

arXiv.org Artificial Intelligence

This thesis introduces the "method of structural refinement", which serves as a means of transforming the relational semantics of a modal and/or constructive logic into an 'economical' proof system by connecting two proof-theoretic paradigms: labelled and nested sequent calculi. The formalism of labelled sequents has been successful in that cut-free calculi in possession of desirable proof-theoretic properties can be automatically generated for large classes of logics. Despite these qualities, labelled systems make use of a complicated syntax that explicitly incorporates the semantics of the associated logic, and such systems typically violate the subformula property to a high degree. By contrast, nested sequent calculi employ a simpler syntax and adhere to a strict reading of the subformula property, making such systems useful in the design of automated reasoning algorithms. However, the downside of the nested sequent paradigm is that a general theory concerning the automated construction of such calculi (as in the labelled setting) is essentially absent, meaning that the construction of nested systems and the confirmation of their properties is usually done on a case-by-case basis. The refinement method connects both paradigms in a fruitful way, by transforming labelled systems into nested (or, refined labelled) systems with the properties of the former preserved throughout the transformation process. To demonstrate the method of refinement and some of its applications, we consider grammar logics, first-order intuitionistic logics, and deontic STIT logics. The introduced refined labelled calculi will be used to provide the first proof-search algorithms for deontic STIT logics. Furthermore, we employ our refined labelled calculi for grammar logics to show that every logic in the class possesses the effective Lyndon interpolation property.


Govt wary of over-regulating AI: Jane Hume - InnovationAus

#artificialintelligence

The government is wary of over-regulating new technologies such as artificial intelligence and will resist making ethics standards and codes mandatory for Australian businesses, Digital Economy minister Jane Hume says. In an address to the Committee for Economic Development of Australia (CEDA), Senator Hume said the federal government would play an enabling role in accelerating the growth of artificial intelligence, along with setting standards in terms of ethics. "AI, along with other digital technologies, will play an increasingly important role in our economy and society over the next decade and beyond," Senator Hume said. "As we continue to vault forward in this space, government has a pivotal role to play as an enabler, and as a standard setter – particularly in regards to ethics. "The government has a significant responsibility … to ensure that AI, as an industry as well as a technology, has every chance to flourish, making sure we have the right settings, skills and expertise in place to ensure Australia is a global forerunner." The May budget allocated $124 million to artificial intelligence initiatives, including $50 million for a National AI Intelligence Centre within CSIRO and $34 million in grants for AI projects addressing national challenges. The Coalition has also unveiled AI ethics principles, with eight guiding principles "designed to help achieve safer and more reliable outcomes for all Australians". These principles and other standards around AI are currently entirely voluntary for Australian businesses, and Senator Hume said the government will avoid making them mandatory. "I obviously would rather have a voluntary code where industry has the input to what's in the code.


Creating Powerful and Interpretable Models withRegression Networks

arXiv.org Artificial Intelligence

As the discipline has evolved, research in machine learning has been focused more and more on creating more powerful neural networks, without regard for the interpretability of these networks. Such "black-box models" yield state-of-the-art results, but we cannot understand why they make a particular decision or prediction. Sometimes this is acceptable, but often it is not. We propose a novel architecture, Regression Networks, which combines the power of neural networks with the understandability of regression analysis. While some methods for combining these exist in the literature, our architecture generalizes these approaches by taking interactions into account, offering the power of a dense neural network without forsaking interpretability. We demonstrate that the models exceed the state-of-the-art performance of interpretable models on several benchmark datasets, matching the power of a dense neural network. Finally, we discuss how these techniques can be generalized to other neural architectures, such as convolutional and recurrent neural networks.


Random vector functional link neural network based ensemble deep learning for short-term load forecasting

arXiv.org Artificial Intelligence

Electricity load forecasting is crucial for the power systems' planning and maintenance. However, its un-stationary and non-linear characteristics impose significant difficulties in anticipating future demand. This paper proposes a novel ensemble deep Random Vector Functional Link (edRVFL) network for electricity load forecasting. The weights of hidden layers are randomly initialized and kept fixed during the training process. The hidden layers are stacked to enforce deep representation learning. Then, the model generates the forecasts by ensembling the outputs of each layer. Moreover, we also propose to augment the random enhancement features by empirical wavelet transformation (EWT). The raw load data is decomposed by EWT in a walk-forward fashion, not introducing future data leakage problems in the decomposition process. Finally, all the sub-series generated by the EWT, including raw data, are fed into the edRVFL for forecasting purposes. The proposed model is evaluated on twenty publicly available time series from the Australian Energy Market Operator of the year 2020. The simulation results demonstrate the proposed model's superior performance over eleven forecasting methods in three error metrics and statistical tests on electricity load forecasting tasks.