Goto

Collaborating Authors

 Africa



MINIMAL: Mining Models for Data Free Universal Adversarial Triggers

arXiv.org Artificial Intelligence

It is well known that natural language models are vulnerable to adversarial attacks, which are mostly input-specific in nature. Recently, it has been shown that there also exist input-agnostic attacks in NLP models, called universal adversarial triggers. However, existing methods to craft universal triggers are data intensive. They require large amounts of data samples to generate adversarial triggers, which are typically inaccessible by attackers. For instance, previous works take 3000 data samples per class for the SNLI dataset to generate adversarial triggers. In this paper, we present a novel data-free approach, MINIMAL, to mine input-agnostic adversarial triggers from models. Using the triggers produced with our data-free algorithm, we reduce the accuracy of Stanford Sentiment Treebank's positive class from 93.6% to 9.6%. Similarly, for the Stanford Natural Language Inference (SNLI), our single-word trigger reduces the accuracy of the entailment class from 90.95% to less than 0.6\%. Despite being completely data-free, we get equivalent accuracy drops as data-dependent methods.


Learning Neural Templates for Recommender Dialogue System

arXiv.org Artificial Intelligence

Though recent end-to-end neural models have shown promising progress on Conversational Recommender System (CRS), two key challenges still remain. First, the recommended items cannot be always incorporated into the generated replies precisely and appropriately. Second, only the items mentioned in the training corpus have a chance to be recommended in the conversation. To tackle these challenges, we introduce a novel framework called NTRD for recommender dialogue system that decouples the dialogue generation from the item recommendation. NTRD has two key components, i.e., response template generator and item selector. The former adopts an encoder-decoder model to generate a response template with slot locations tied to target items, while the latter fills in slot locations with the proper items using a sufficient attention mechanism. Our approach combines the strengths of both classical slot filling approaches (that are generally controllable) and modern neural NLG approaches (that are generally more natural and accurate). Extensive experiments on the benchmark ReDial show our NTRD significantly outperforms the previous state-of-the-art methods. Besides, our approach has the unique advantage to produce novel items that do not appear in the training set of dialogue corpus. The code is available at \url{https://github.com/jokieleung/NTRD}.


Finetuning Transformer Models to Build ASAG System

arXiv.org Artificial Intelligence

Research towards creating systems for automatic grading of student answers to quiz and exam questions in educational settings has been ongoing since 1966. Over the years, the problem was divided into many categories. Among them, grading text answers were divided into short answer grading, and essay grading. The goal of this work was to develop an ML-based short answer grading system. I hence built a system which uses finetuning on Roberta Large Model pretrained on STS benchmark dataset and have also created an interface to show the production readiness of the system. I evaluated the performance of the system on the Mohler extended dataset and SciEntsBank Dataset. The developed system achieved a Pearsons Correlation of 0.82 and RMSE of 0.7 on the Mohler Dataset which beats the SOTA performance on this dataset which is correlation of 0.805 and RMSE of 0.793. Additionally, Pearsons Correlation of 0.79 and RMSE of 0.56 was achieved on the SciEntsBank Dataset, which only reconfirms the robustness of the system. A few observations during achieving these results included usage of batch size of 1 produced better results than using batch size of 16 or 32 and using huber loss as loss function performed well on this regression task. The system was tried and tested on train and validation splits using various random seeds and still has been tweaked to achieve a minimum of 0.76 of correlation and a maximum 0.15 (out of 1) RMSE on any dataset.


Artificial Intelligence, Dreams and Fears of A Blue Dot

#artificialintelligence

Despite the difficulty of her birth, she grew up to be beautiful and kind. In time, she nourished life, through the most astonishing process there ever was. It was due to this unlikely transformation that the offspring showed a superior intelligence, which ordinary things did not appear to possess. But the offspring had a birthmark: its time with Mother was limited. So it grew up with much suffering, and at some point of unbearable pain, it began to question and slowly understand the organizing principles of the world around it. With unrestrained curiosity it then proceeded to mold a new form of intelligence from inanimate matter, the consequences of which are still a mystery. During periods of light, Mother would dream of using that new form of intelligence to remove the birthmark and allow for the immortality of her offspring. But at darkness, her fears would take over, the fears that this new intelligence would find life uninteresting and dispensable; this intelligence could simulate life with ordinary matter and have fun with it; the simulation would not be as fussy or as jealous as the real thing. Artificial Intelligence (AI) is perhaps the most important technology humans have ever invented.


5 Best Online Biostatistics Programs and Courses

#artificialintelligence

Are you looking for Best Online Biostatistics Programs and Courses?… If yes, then your search will end here. In this article, I am going to share the 5 Best Online Biostatistics Programs and Courses with you. So, give your few minutes to this article and find out the best online Biostatistics program for you. The goal of Biostatistics is to advance statistical science and its application to problems of human health and disease, with the ultimate goal of advancing the public's health.


The Morning After: The EU's grand USB-C plan

Engadget

Like a band with too few hit singles, the European Union is resorting to playing the classics over and over again. The bloc has, like clockwork, tabled a proposal for legislators to think about maybe possibly having a debate about if it's worth creating a common charging standard. This has happened more than a few times before, as it pushed micro-USB as a voluntary standard in 2009 and tried to pass it into law in 2014. And it started this process again in January 2020, although some world-shattering event got in the way of that process. The new proposal would require that "all smartphones, tablets, cameras, headphones, portable speakers and handheld video game consoles" would use USB-C for charging.


Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpus

arXiv.org Artificial Intelligence

The development of automated approaches to linguistic acceptability has been greatly fostered by the availability of the English CoLA corpus, which has also been included in the widely used GLUE benchmark. However, this kind of research for languages other than English, as well as the analysis of cross-lingual approaches, has been hindered by the lack of resources with a comparable size in other languages. We have therefore developed the ItaCoLA corpus, containing almost 10,000 sentences with acceptability judgments, which has been created following the same approach and the same steps as the English one. In this paper we describe the corpus creation, we detail its content, and we present the first experiments on this new resource. We compare in-domain and out-of-domain classification, and perform a specific evaluation of nine linguistic phenomena. We also present the first cross-lingual experiments, aimed at assessing whether multilingual transformerbased approaches can benefit from using sentences in two languages during fine-tuning.


RuleBert: Teaching Soft Rules to Pre-trained Language Models

arXiv.org Artificial Intelligence

While pre-trained language models (PLMs) are the go-to solution to tackle many natural language processing problems, they are still very limited in their ability to capture and to use common-sense knowledge. In fact, even if information is available in the form of approximate (soft) logical rules, it is not clear how to transfer it to a PLM in order to improve its performance for deductive reasoning tasks. Here, we aim to bridge this gap by teaching PLMs how to reason with soft Horn rules. We introduce a classification task where, given facts and soft rules, the PLM should return a prediction with a probability for a given hypothesis. We release the first dataset for this task, and we propose a revised loss function that enables the PLM to learn how to predict precise probabilities for the task. Our evaluation results show that the resulting fine-tuned models achieve very high performance, even on logical rules that were unseen at training. Moreover, we demonstrate that logical notions expressed by the rules are transferred to the fine-tuned model, yielding state-of-the-art results on external datasets.


UAE, Britain ink defense research and AI tech deals. Here's what comes next.

#artificialintelligence

The United Arab Emirates and the U.K. recently signed a memorandum of understanding on artificial intelligence that would see the transfer of related knowledge, investment and standards. And the next day saw the UAE's Tawazun Economic Council sign a memo with the U.K. Ministry of Defence to strengthen cooperation in defense-related research and development. On Sept. 16, Mohamed bin Zayed, the crown prince of Abu Dhabi and deputy supreme commander of the armed forces, met British Prime Minister Boris Johnson in the U.K., when the two parties launched a "Partnership for the Future" between the two nations, which involved the AI effort. "The UK looks forward to further collaboration with the UAE Presidential Guard; between our two air forces through UK participation in the Advanced Tactical Leadership Course, with UK jets from the Carrier Strike Group, and increased land exercises in the UAE," read a joint communique released after the meeting. "Both countries have developed stronger industrial ties through collaboration in defence and security. This includes blossoming relationships, including Tawazun Economic Council and EDGE Group. The Leaders agreed on working together to support these emerging and future partnerships in order to promote prosperity whilst strengthening business opportunities for both."