Goto

Collaborating Authors

 Oceania


POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labelling

arXiv.org Artificial Intelligence

Conversational search systems, such as Google Assistant and Microsoft Cortana, provide a new search paradigm where users are allowed, via natural language dialogues, to communicate with search systems. Evaluating such systems is very challenging since search results are presented in the format of natural language sentences. Given the unlimited number of possible responses, collecting relevance assessments for all the possible responses is infeasible. In this paper, we propose POSSCORE, a simple yet effective automatic evaluation method for conversational search. The proposed embedding-based metric takes the influence of part of speech (POS) of the terms in the response into account. To the best knowledge, our work is the first to systematically demonstrate the importance of incorporating syntactic information, such as POS labels, for conversational search evaluation. Experimental results demonstrate that our metrics can correlate with human preference, achieving significant improvements over state-of-the-art baseline metrics.


Sequential Attention Module for Natural Language Processing

arXiv.org Artificial Intelligence

Recently, large pre-trained neural language models have attained remarkable performance on many downstream natural language processing (NLP) applications via fine-tuning. In this paper, we target at how to further improve the token representations on the language models. We, therefore, propose a simple yet effective plug-and-play module, Sequential Attention Module (SAM), on the token embeddings learned from a pre-trained language model. Our proposed SAM consists of two main attention modules deployed sequentially: Feature-wise Attention Module (FAM) and Token-wise Attention Module (TAM). More specifically, FAM can effectively identify the importance of features at each dimension and promote the effect via dot-product on the original token embeddings for downstream NLP applications. Meanwhile, TAM can further re-weight the features at the token-wise level. Moreover, we propose an adaptive filter on FAM to prevent noise impact and increase information absorption. Finally, we conduct extensive experiments to demonstrate the advantages and properties of our proposed SAM. We first show how SAM plays a primary role in the champion solution of two subtasks of SemEval'21 Task 7. After that, we apply SAM on sentiment analysis and three popular NLP tasks and demonstrate that SAM consistently outperforms the state-of-the-art baselines.


Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledge

arXiv.org Artificial Intelligence

One challenge for dialogue agents is to recognize feelings of the conversation partner and respond accordingly. In this work, RoBERTa-GPT2 is proposed for empathetic dialogue generation, where the pre-trained auto-encoding RoBERTa is utilised as encoder and the pre-trained auto-regressive GPT-2 as decoder. With the combination of the pre-trained RoBERTa and GPT-2, our model realizes a new state-of-the-art emotion accuracy. To enable the empathetic ability of RoBERTa-GPT2 model, we propose a commonsense knowledge and emotional concepts extractor, in which the commonsensible and emotional concepts of dialogue context are extracted for the GPT-2 decoder. The experiment results demonstrate that the empathetic dialogue generation benefits from both pre-trained encoder-decoder architecture and external knowledge.


Readying Medical Students for Medical AI: The Need to Embed AI Ethics Education

arXiv.org Artificial Intelligence

Medical students will almost inevitably encounter powerful medical AI systems early in their careers. Yet, contemporary medical education does not adequately equip students with the basic clinical proficiency in medical AI needed to use these tools safely and effectively. Education reform is urgently needed, but not easily implemented, largely due to an already jam-packed medical curricula. In this article, we propose an education reform framework as an effective and efficient solution, which we call the Embedded AI Ethics Education Framework. Unlike other calls for education reform to accommodate AI teaching that are more radical in scope, our framework is modest and incremental. It leverages existing bioethics or medical ethics curricula to develop and deliver content on the ethical issues associated with medical AI, especially the harms of technology misuse, disuse, and abuse that affect the risk-benefit analyses at the heart of healthcare. In doing so, the framework provides a simple tool for going beyond the "What?" and the "Why?" of medical AI ethics education, to answer the "How?", giving universities, course directors, and/or professors a broad road-map for equipping their students with the necessary clinical proficiency in medical AI.


Music Composition with Deep Learning: A Review

arXiv.org Artificial Intelligence

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic methods and recently, with Deep Learning models that are being used in other fields such as Computer Vision. In this paper we want to put into context the existing relationships between AI-based music composition models and human musical composition and creativity processes. We give an overview of the recent Deep Learning models for music composition and we compare these models to the music composition process from a theoretical point of view. We have tried to answer some of the most relevant open questions for this task by analyzing the ability of current Deep Learning models to generate music with creativity or the similarity between AI and human composition processes, among others.


An AI Can File A Patent Application

#artificialintelligence

The emergence of artificial intelligence-related technology as a means of innovation has led to uncertainties for companies across industries, primarily because patent law has historically held that intellectual property rights be assigned only to humans. Now, in a landmark decision, an Australian court has set a groundbreaking precedent, deciding AI systems can be legally recognised as an inventor in patent applications, challenging a fundamental assumption in the law: that only human beings can be inventors. The AI machine called DABUS is an "artificial neural system" and its designs have set off a string of debates and court battles across the globe. Australia's Federal Court has now made the new law that "the inventor can be non-human" in the same month that South Africa became the first country to defy the status quo and award a patent recognising DABUS as an inventor. AI inventor and creator of DABUS, Stephen Thaler has been running a sutained global campaign to have DABUS recognised as an inventor for more than two years.


The man making antibodies smarter

#artificialintelligence

Prof. Yanay Ofran's amazing story about the pursuit of an antibody that will save the world from disease Shlomit Lan and Gali Weinreb Professor Yanay Ofran, founder and CEO of Biolojic Design, a company that develops smart antibodies designed to treat a variety of diseases, is frustrated. "Humanity invests $300 billion each year in drug development, and what do we get? At most, we get a few dozen medications a year, most of which don't solve the problems, and give an additional three weeks of life on average to patients with pancreatic cancer, or manage to inject a medication that to date was given via infusion. Those are the breakthroughs," he says despairingly. But Ofran does not think the pharmaceutical companies are the only culprit. "The drug companies are portrayed as a devil who says, 'I won't cure this because it's not worth my while.' But these companies do have a legal obligation towards their shareholders, not to develop drugs unless there's an economic incentive. The problem, as analyzed by Ofran, is much more complicated and therefore far more difficult to treat. "There are three players sitting around the drug development table: science, regulation and the business world.


Privacy Enhancing Technologies and why they matter

#artificialintelligence

The COVID-19 pandemic has supercharged the scope of the issues the global healthcare industry was already grappling with. When the pandemic arrived, healthcare organisations often struggled to find the basic information they needed to respond -- whether it was disease and death rates or the availability of hospital beds and critical supplies. Among other problems, the pandemic highlighted the desperate need for collaborative data analytics in healthcare. As McKinsey observed, healthcare's digital barriers are often decidedly non-technological. The technology is out there (or rapidly evolving) -- in October 2020, Pfizer and IBM researchers announced that they have developed a machine learning technique that can predict Alzheimer's disease years before symptoms develop.


The Data Analyst Course: Complete Data Analyst Bootcamp 2021

#artificialintelligence

Created by Andrei Neagoie, Daniel BourkePreview this Course - GET COUPON CODE This is a brand new Machine Learning and Data Science course just launched and updated this month with the latest trends and skills for 2021! Become a complete Data Scientist and Machine Learning engineer! Join a live online community of 400,000 engineers and a course taught by industry experts that have actually worked for large companies in places like Silicon Valley and Toronto. Graduates of Andrei's courses are now working at Google, Tesla, Amazon, Apple, IBM, JP Morgan, Facebook, other top tech companies. You will go from zero to mastery! Learn Data Science and Machine Learning from scratch, get hired, and have fun along the way with the most modern, up-to-date Data Science course on Udemy (we use the latest version of Python, Tensorflow 2.0 and other libraries).


Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guesser

arXiv.org Artificial Intelligence

Considering the importance of building a good Visual Dialog (VD) Questioner, many researchers study the topic under a Q-Bot-A-Bot image-guessing game setting, where the Questioner needs to raise a series of questions to collect information of an undisclosed image. Despite progress has been made in Supervised Learning (SL) and Reinforcement Learning (RL), issues still exist. Firstly, previous methods do not provide explicit and effective guidance for Questioner to generate visually related and informative questions. Secondly, the effect of RL is hampered by an incompetent component, i.e., the Guesser, who makes image predictions based on the generated dialogs and assigns rewards accordingly. To enhance VD Questioner: 1) we propose a Related entity enhanced Questioner (ReeQ) that generates questions under the guidance of related entities and learns entity-based questioning strategy from human dialogs; 2) we propose an Augmented Guesser (AugG) that is strong and is optimized for the VD setting especially. Experimental results on the VisDial v1.0 dataset show that our approach achieves state-of-theart performance on both image-guessing task and question diversity. Human study further proves that our model generates more visually related, informative and coherent questions.