Oceania
AI Year in Review: A Busy 2022 for AI and IP Promises Even More in 2023
"Throughout 2021 and 2022, the world began to experiment with a massive influx of commercially available AI-assisted and AI-powered tools that can be used, whether knowingly or unknowingly, during the process of creating, researching, and innovating. Looking ahead to 2023, we will start witnessing the legal and regulatory impact of these tools." In general, the adoption of artificial intelligence (AI) and machine learning technologies has the potential to impact society in many ways. These technologies can automate tasks and make them more efficient, which can lead to job displacement and other economic impacts. They can also be used to make decisions that affect people's lives, such as in the criminal justice system or in hiring, which raises ethical concerns.
Transforming Organizational Strategies with The Power of AI
To survive and remain competitive in today's economic and business environment, organizations must lead large-scale changes. Constant organizational change is the new normal in an ever-changing political, social, and economical atmosphere. Artificial intelligence is one of the few innovations that have the potential to assist businesses to transcend significant commercial chasms. AI has immense potential to rocket businesses above the established order and adapts to the new dynamics in business operations. The year 2016 marked the beginning of the business world's recognition of AI potential.
The dawn of AI has come
The release of OpenAI's ChatGPT chatbot has given us a glimpse into the future of teaching and learning alongside artificial intelligence. Educators immediately pointed out the chatbot's ability to generate meaningful responses to questions from assessments and exams. And it is often not possible to attribute these responses to a particular source – making it difficult to detect plagiarism. Shortly after ChatGPT's release, OpenAI announced that it was developing a "digital watermark" to embed into the chatbot's responses. This kind of watermark is embedded as a digital signal that can identify the content as being AI-generated and which (in theory) should be difficult to remove.
Top five technologies that will transform the Fintech sector
Before we consider the five technologies that are set to transform Fintech, consider what Fintech is. Fintech is the synthesis of technology and finance and the harmonic combination of two of the largest industries into a single field. Naturally, its impact is enormous. Regarded as cutting-edge innovations a few years ago, now Fintech solutions are a daily reality. According to McKinsey, 80% of traditional financial institutions were exploring innovations in 2018.
Probing the properties of molecules and complex materials using machine learning
The application of machine learning to predicting the properties of small and large discrete (single) molecules and complex materials (polymeric, extended or mixtures of molecules) has been increasing exponentially over the past few decades. Unlike physics-based and rule-based computational systems, machine learning algorithms can learn complex relationships between physicochemical and process parameters and their useful properties for an extremely diverse range of molecular entities. Both the breadth of machine learning methods and the range of physical, chemical, materials, biological, medical and many other application areas have increased markedly in the past decade. This Account summarises three decades of research into improved cheminformatics and machine learning methods and their application to drug design, regenerative medicine, biomaterials, porous and 2D materials, catalysts, biomarkers, surface science, physicochemical and phase properties, nanomaterials, electrical and optical properties, corrosion and battery research. Science has always been fascinated by change, uncovering new aspects of Nature and finding useful ways to exploit them to meet global challenges. The rate of change is accelerating, with average time between innovations decreasing exponentially (Figure 1). Computational molecular design prior to 1990 was focused on the use of computationally expensive physics-based methods like molecular modelling, molecular mechanics, molecular dynamics and quantum chemistry. The quantitative structure–activity relationship (QSAR) methods, developed by Hansch and Fujita in the 1960s, were based on the observation that changes in the constitution of small organic molecules generated a corresponding change in their biological activities. Regression methods were used to find relationships between structure, encoded by mathematical entities called descriptors or features, and biological properties of small organic molecules, also numerically encoded. QSAR use was limited to modelling of small data sets of molecules with similar scaffolds, with the primary aim of understanding the molecular basis for drug (or agrochemical) action. As they were not mechanism- or physics-based, their empirical nature created doubt as to their efficacy, the question of when correlation means causation (still an important issue), and lack of data were major barriers to their wider adoption. After that time, technological developments involving automation, computational power, algorithms, synthesis and informatics have maintained this exponential acceleration.
LaSQuE: Improved Zero-Shot Classification from Explanations Through Quantifier Modeling and Curriculum Learning
Ghosh, Sayan, Menon, Rakesh R, Srivastava, Shashank
A hallmark of human intelligence is the ability to learn new concepts purely from language. Several recent approaches have explored training machine learning models via natural language supervision. However, these approaches fall short in leveraging linguistic quantifiers (such as 'always' or 'rarely') and mimicking humans in compositionally learning complex tasks. Here, we present LaSQuE, a method that can learn zero-shot classifiers from language explanations by using three new strategies - (1) modeling the semantics of linguistic quantifiers in explanations (including exploiting ordinal strength relationships, such as 'always' > 'likely'), (2) aggregating information from multiple explanations using an attention-based mechanism, and (3) model training via curriculum learning. With these strategies, LaSQuE outperforms prior work, showing an absolute gain of up to 7% in generalizing to unseen real-world classification tasks.
MeSH Suggester: A Library and System for MeSH Term Suggestion for Systematic Review Boolean Query Construction
Wang, Shuai, Li, Hang, Zuccon, Guido
Boolean query construction is often critical for medical systematic review literature search. To create an effective Boolean query, systematic review researchers typically spend weeks coming up with effective query terms and combinations. One challenge to creating an effective systematic review Boolean query is the selection of effective MeSH Terms to include in the query. In our previous work, we created neural MeSH term suggestion methods and compared them to state-of-the-art MeSH term suggestion methods. We found neural MeSH term suggestion methods to be highly effective. In this demonstration, we build upon our previous work by creating (1) a Web-based MeSH term suggestion prototype system that allows users to obtain suggestions from a number of underlying methods and (2) a Python library that implements ours and others' MeSH term suggestion methods and that is aimed at researchers who want to further investigate, create or deploy such type of methods. We describe the architecture of the web-based system and how to use it for the MeSH term suggestion task. For the Python library, we describe how the library can be used for advancing further research and experimentation, and we validate the results of the methods contained in the library on standard datasets. Our web-based prototype system is available at http://ielab-mesh-suggest.uqcloud.net, while our Python library is at https://github.com/ielab/meshsuggestlib.
Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search
Wang, Shuai, Scells, Harrisen, Koopman, Bevan, Zuccon, Guido
Medical systematic reviews typically require assessing all the documents retrieved by a search. The reason is two-fold: the task aims for ``total recall''; and documents retrieved using Boolean search are an unordered set, and thus it is unclear how an assessor could examine only a subset. Screening prioritisation is the process of ranking the (unordered) set of retrieved documents, allowing assessors to begin the downstream processes of the systematic review creation earlier, leading to earlier completion of the review, or even avoiding screening documents ranked least relevant. Screening prioritisation requires highly effective ranking methods. Pre-trained language models are state-of-the-art on many IR tasks but have yet to be applied to systematic review screening prioritisation. In this paper, we apply several pre-trained language models to the systematic review document ranking task, both directly and fine-tuned. An empirical analysis compares how effective neural methods compare to traditional methods for this task. We also investigate different types of document representations for neural methods and their impact on ranking performance. Our results show that BERT-based rankers outperform the current state-of-the-art screening prioritisation methods. However, BERT rankers and existing methods can actually be complementary, and thus, further improvements may be achieved if used in conjunction.
Let's Negotiate! A Survey of Negotiation Dialogue Systems
Zhan, Haolan, Wang, Yufei, Feng, Tao, Hua, Yuncheng, Sharma, Suraj, Li, Zhuang, Qu, Lizhen, Haffari, Gholamreza
Negotiation is one of the crucial abilities in human communication, and there has been a resurgent research interest in negotiation dialogue systems recently, which goal is to empower intelligent agents with such ability that can efficiently help humans resolve conflicts or reach beneficial agreements. Although there have been many explorations in negotiation dialogue systems, a systematic review of this task has to date remained notably absent. To this end, we aim to fill this gap by reviewing contemporary studies in the emerging field of negotiation dialogue systems, covering benchmarks, evaluations, and methodologies. Furthermore, we also discuss potential future directions, including multi-modal, multi-party, and cross-cultural negotiation scenarios. Our goal is to provide the community with a systematic overview of negotiation dialogue systems and to inspire future research.
The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matrices
Ma, Wanlun, Wang, Derui, Sun, Ruoxi, Xue, Minhui, Wen, Sheng, Xiang, Yang
Deep Neural Networks (DNNs) are susceptible to backdoor attacks during training. The model corrupted in this way functions normally, but when triggered by certain patterns in the input, produces a predefined target label. Existing defenses usually rely on the assumption of the universal backdoor setting in which poisoned samples share the same uniform trigger. However, recent advanced backdoor attacks show that this assumption is no longer valid in dynamic backdoors where the triggers vary from input to input, thereby defeating the existing defenses. In this work, we propose a novel technique, Beatrix (backdoor detection via Gram matrix). Beatrix utilizes Gram matrix to capture not only the feature correlations but also the appropriately high-order information of the representations. By learning class-conditional statistics from activation patterns of normal samples, Beatrix can identify poisoned samples by capturing the anomalies in activation patterns. To further improve the performance in identifying target labels, Beatrix leverages kernel-based testing without making any prior assumptions on representation distribution. We demonstrate the effectiveness of our method through extensive evaluation and comparison with state-of-the-art defensive techniques. The experimental results show that our approach achieves an F1 score of 91.1% in detecting dynamic backdoors, while the state of the art can only reach 36.9%.