Oceania
Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalization
Lee, Dongkyu, Tian, Zhiliang, Xue, Lanqing, Zhang, Nevin L.
Text style transfer aims to alter the style (e.g., sentiment) of a sentence while preserving its content. A common approach is to map a given sentence to content representation that is free of style, and the content representation is fed to a decoder with a target style. Previous methods in filtering style completely remove tokens with style at the token level, which incurs the loss of content information. In this paper, we propose to enhance content preservation by implicitly removing the style information of each token with reverse attention, and thereby retain the content. Furthermore, we fuse content information when building the target style representation, making it dynamic with respect to the content. Our method creates not only style-independent content representation, but also content-dependent style representation in transferring style. Empirical results show that our method outperforms the state-of-the-art baselines by a large margin in terms of content preservation. In addition, it is also competitive in terms of style transfer accuracy and fluency.
Pure Exploration and Regret Minimization in Matching Bandits
Sentenac, Flore, Yi, Jialin, Calauzènes, Clément, Perchet, Vianney, Vojnovic, Milan
Finding an optimal matching in a weighted graph is a standard combinatorial problem. We consider its semi-bandit version where either a pair or a full matching is sampled sequentially. We prove that it is possible to leverage a rank-1 assumption on the adjacency matrix to reduce the sample complexity and the regret of off-the-shelf algorithms up to reaching a linear dependency in the number of vertices (up to poly log terms).
Applications of Artificial Neural Networks in Microorganism Image Analysis: A Comprehensive Review from Conventional Multilayer Perceptron to Popular Convolutional Neural Network and Potential Visual Transformer
Zhang, Jinghua, Li, Chen, Grzegorzek, Marcin
Microorganisms are widely distributed in the human daily living environment. They play an essential role in environmental pollution control, disease prevention and treatment, and food and drug production. The identification, counting, and detection are the basic steps for making full use of different microorganisms. However, the conventional analysis methods are expensive, laborious, and time-consuming. To overcome these limitations, artificial neural networks are applied for microorganism image analysis. We conduct this review to understand the development process of microorganism image analysis based on artificial neural networks. In this review, the background and motivation are introduced first. Then, the development of artificial neural networks and representative networks are introduced. After that, the papers related to microorganism image analysis based on classical and deep neural networks are reviewed from the perspectives of different tasks. In the end, the methodology analysis and potential direction are discussed.
Towards Adversarially Robust and Domain Generalizable Stereo Matching by Rethinking DNN Feature Backbones
Cheng, Kelvin, Healey, Christopher, Wu, Tianfu
Stereo matching has recently witnessed remarkable progress using Deep Neural Networks (DNNs). But, how robust are they? Although it has been well-known that DNNs often suffer from adversarial vulnerability with a catastrophic drop in performance, the situation is even worse in stereo matching. This paper first shows that a type of weak white-box attacks can fail state-of-the-art methods. The attack is learned by a proposed stereo-constrained projected gradient descent (PGD) method in stereo matching. This observation raises serious concerns for the deployment of DNN-based stereo matching. Parallel to the adversarial vulnerability, DNN-based stereo matching is typically trained under the so-called simulation to reality pipeline, and thus domain generalizability is an important problem. This paper proposes to rethink the learnable DNN-based feature backbone towards adversarially-robust and domain generalizable stereo matching, either by completely removing it or by applying it only to the left reference image. It computes the matching cost volume using the classic multi-scale census transform (i.e., local binary pattern) of the raw input stereo images, followed by a stacked Hourglass head sub-network solving the matching problem. In experiments, the proposed method is tested in the SceneFlow dataset and the KITTI2015 benchmark. It significantly improves the adversarial robustness, while retaining accuracy performance comparable to state-of-the-art methods. It also shows better generalizability from simulation (SceneFlow) to real (KITTI) datasets when no fine-tuning is used.
Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition
Suresh, Varsha, Ong, Desmond C.
Imagine telling your chatbot that your dog just died. Instead In this work, we introduce Knowledge-Embedded Attention of correctly understanding that you are experiencing grief (and (KEA), a knowledge-augmented attention mechanism that offering condolences), it classifies you as feeling sad and offers enriches the contextual representation provided by pre-trained to play you a happy song to cheer you up. People experience language models using emotional information obtained from a wide range of emotions, and it is important for AI agents external knowledge sources. This is achieved by incorporating to correctly recognize subtle differences between emotions the encoded emotional knowledge with the contextual representations like sadness and grief, in order to improve their interactions to form a modified key matrix. This key matrix with people and to avoid making a faux pas like the chatbot is then used to attend to the contextual representations to above [1]. Traditionally, the vast majority of work in emotion construct a more emotionally-aware representation of the input recognition from text focuses on recognizing just six "basic" text that can be used to recognise emotions. We introduce two emotions [2], [3], usually happiness, surprise, sadness, anger, variants of KEA, (i) a word-level KEA and (ii) a sentencelevel disgust, and fear. This set clearly fails to capture the broad KEA, which incorporate knowledge at different text spectrum of emotions that people experience and express in granularities.
I'm sorry Dave I'm afraid I invented that: Australian court finds AI systems can be recognised under patent law
An artificial intelligence system is capable of being an "inventor" under Australian patent law, the federal court has ruled, in a decision that could have wider intellectual property implications. University of Surrey professor Ryan Abbott has launched more than a dozen patent applications across the globe, including in the UK, US, New Zealand and Australia, on behalf of US-based Dr Stephen Thaler. They seek to have Thaler's artificial intelligence device known as Dabus (a device for the autonomous bootstrapping of unified sentience) listed as the inventor. The applications claimed Dabus, which is made up of artificial neural networks, invented an emergency warning light and a type of food container, among other inventions. Several countries, including Australia, had rejected the applications, stating a human must be named the inventor.
The best consultancy for business, with sales and marketing data insights too: we review
With digital marketing, good, clean, and insightful data is a key pillar which a business stands to drive growth and profits. Having clear and precise data-driven outcomes should be a priority for all marketers. When used in tandem with well-defined marketing and sales goals, and various marketing tools and techniques, companies will discover that their lead to sale conversion process can be far less cumbersome and more rewarding. Possessing clean data will help marketers identify detailed segments based on user attributes, past behaviours, interactions, and other necessary data points. Data can be leveraged for highly targeted campaigns which will drive marketing return on investment (ROI).
Active Learning in Gaussian Process State Space Model
Yu, Hon Sum Alec, Yao, Dingling, Zimmer, Christoph, Toussaint, Marc, Nguyen-Tuong, Duy
We investigate active learning in Gaussian Process state-space models (GPSSM). Our problem is to actively steer the system through latent states by determining its inputs such that the underlying dynamics can be optimally learned by a GPSSM. In order that the most informative inputs are selected, we employ mutual information as our active learning criterion. In particular, we present two approaches for the approximation of mutual information for the GPSSM given latent states. The proposed approaches are evaluated in several physical systems where we actively learn the underlying non-linear dynamics represented by the state-space model.
Towards Continual Entity Learning in Language Models for Conversational Agents
Gadde, Ravi Teja, Bulyko, Ivan
Neural language models (LM) trained on diverse corpora are known to work well on previously seen entities, however, updating these models with dynamically changing entities such as place names, song titles and shopping items requires re-training from scratch and collecting full sentences containing these entities. We aim to address this issue, by introducing entity-aware language models (EALM), where we integrate entity models trained on catalogues of entities into the pre-trained LMs. Our combined language model adaptively adds information from the entity models into the pre-trained LM depending on the sentence context. Our entity models can be updated independently of the pre-trained LM, enabling us to influence the distribution of entities output by the final LM, without any further training of the pre-trained LM. We show significant perplexity improvements on task-oriented dialogue datasets, especially on long-tailed utterances, with an ability to continually adapt to new entities (to an extent).
Refining Labelled Systems for Modal and Constructive Logics with Applications
This thesis introduces the "method of structural refinement", which serves as a means of transforming the relational semantics of a modal and/or constructive logic into an 'economical' proof system by connecting two proof-theoretic paradigms: labelled and nested sequent calculi. The formalism of labelled sequents has been successful in that cut-free calculi in possession of desirable proof-theoretic properties can be automatically generated for large classes of logics. Despite these qualities, labelled systems make use of a complicated syntax that explicitly incorporates the semantics of the associated logic, and such systems typically violate the subformula property to a high degree. By contrast, nested sequent calculi employ a simpler syntax and adhere to a strict reading of the subformula property, making such systems useful in the design of automated reasoning algorithms. However, the downside of the nested sequent paradigm is that a general theory concerning the automated construction of such calculi (as in the labelled setting) is essentially absent, meaning that the construction of nested systems and the confirmation of their properties is usually done on a case-by-case basis. The refinement method connects both paradigms in a fruitful way, by transforming labelled systems into nested (or, refined labelled) systems with the properties of the former preserved throughout the transformation process. To demonstrate the method of refinement and some of its applications, we consider grammar logics, first-order intuitionistic logics, and deontic STIT logics. The introduced refined labelled calculi will be used to provide the first proof-search algorithms for deontic STIT logics. Furthermore, we employ our refined labelled calculi for grammar logics to show that every logic in the class possesses the effective Lyndon interpolation property.