Goto

Collaborating Authors

 Overview


ML + FV = $\heartsuit$? A Survey on the Application of Machine Learning to Formal Verification

arXiv.org Artificial Intelligence

Formal Verification (Fv) and Machine Learning (Ml) can seem incompatible due to their opposite mathematical foundations and their use in real-life problems: Fv mostly relies on discrete mathematics and aims at ensuring correctness; Ml often relies on probabilistic models and consists of learning patterns from training data. In this paper, we postulate that they are complementary in practice, and explore how Ml helps Fv in its classical approaches: static analysis, model-checking, theorem-proving, and Sat solving. We draw a landscape of the current practice and catalog some of the most prominent uses of Ml inside Fv tools, thus offering a new perspective on Fv techniques that can help researchers and practitioners to better locate the possible synergies. We discuss lessons learned from our work, point to possible improvements and offer visions for the future of the domain in the light of the science of software and systems modeling.


Lecture Notes on Fair Division

arXiv.org Artificial Intelligence

Fair division is the problem of dividing one or several goods amongst two or more agents in a way that satisfies a suitable fairness criterion. That is, fair division may be considered part of the larger research area of multiagent resource allocation (Chevaleyre et al., 2006). What is special about fair division is the explicit focus on fairness concerns. These notes give a succinct introduction to the field, focusing on formal and computational aspects that are particularly relevant to research in Computational Social Choice (Chevaleyre et al., 2007b) and Multiagent Systems (Wooldridge, 2009). We begin by briefly outlining how fair division fits into (and relates to) these two disciplines. Like voting, the archetypical instance of a social choice problem, fair division amounts to selecting an outcome from a set of possible collective agreements, given the individual preferences of a group of agents. There are however two main differences when compared to voting. The first difference is that, typically, voting theory assumes that agents (voters) have ordinal preferences (that is, they rank the available candidates and can say for any two candidates which one they like more), while in the context of fair division we usually assume that agents have cardinal preferences (that is, each agent has got a utility function mapping possible outcomes to appropriate numerical values). The second difference is that a fair division problem comes with a certain internal "structure" that is typically absent from problems in voting:


iParaphrasing: Extracting Visually Grounded Paraphrases via an Image

arXiv.org Artificial Intelligence

A paraphrase is a restatement of the meaning of a text in other words. Paraphrases have been studied to enhance the performance of many natural language processing tasks. In this paper, we propose a novel task iParaphrasing to extract visually grounded paraphrases (VGPs), which are different phrasal expressions describing the same visual concept in an image. These extracted VGPs have the potential to improve language and image multimodal tasks such as visual question answering and image captioning. How to model the similarity between VGPs is the key of iParaphrasing. We apply various existing methods as well as propose a novel neural network-based method with image attention, and report the results of the first attempt toward iParaphrasing.


Top Artificial Intelligence Books to Read in 2018 MarkTechPost

#artificialintelligence

A Modern Approach, 3e offers the most comprehensive, up-to-date introduction to the theory and practice of artificial intelligence. Number one in its field, this textbook is ideal for one or two-semester, undergraduate or graduate-level courses in Artificial Intelligence. In this mind-expanding book, scientific pioneer Marvin Minsky continues his groundbreaking research, offering a fascinating new model for how our minds work. He argues persuasively that emotions, intuitions, and feelings are not distinct things, but different ways of thinking. Introduction to Artificial Intelligence presents an introduction to the science of reasoning processes in computers, and the research approaches and results of the past two decades.


Efficient Optimization Algorithms for Robust Principal Component Analysis and Its Variants

arXiv.org Machine Learning

Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision. Robust PCA and its variants such as sparse PCA and stable PCA can be formulated as optimization problems with exploitable special structures. Many specialized efficient optimization methods have been proposed to solve robust PCA and related problems. In this paper we review existing optimization methods for solving convex and nonconvex relaxations/variants of robust PCA, discuss their advantages and disadvantages, and elaborate on their convergence behaviors. We also provide some insights for possible future research directions including new algorithmic frameworks that might be suitable for implementing on multi-processor setting to handle large-scale problems.


A Taxonomy and Survey of Intrusion Detection System Design Techniques, Network Threats and Datasets

arXiv.org Artificial Intelligence

With the world moving towards being increasingly dependent on computers and automation, one of the main challenges in the current decade has been to build secure applications, systems and networks. Alongside these challenges, the number of threats is rising exponentially due to the attack surface increasing through numerous interfaces offered for each service. To alleviate the impact of these threats, researchers have proposed numerous solutions; however, current tools often fail to adapt to ever-changing architectures, associated threats and 0-days. This manuscript aims to provide researchers with a taxonomy and survey of current dataset composition and current Intrusion Detection Systems (IDS) capabilities and assets. These taxonomies and surveys aim to improve both the efficiency of IDS and the creation of datasets to build the next generation IDS as well as to reflect networks threats more accurately in future datasets. To this end, this manuscript also provides a taxonomy and survey or network threats and associated tools. The manuscript highlights that current IDS only cover 25% of our threat taxonomy, while current datasets demonstrate clear lack of real-network threats and attack representation, but rather include a large number of deprecated threats, hence limiting the accuracy of current machine learning IDS. Moreover, the taxonomies are open-sourced to allow public contributions through a Github repository.


5 technologies that will forever change global trade

#artificialintelligence

International trade has dominated the global headlines recently. Much of the discussions have been focused on the threat of a trade war, the tit-for-tat tariffs, and the health of the global trade order. While extremely important, these conversations are missing a brighter side of international trade – how innovative technologies in the Fourth Industrial Revolution are transforming trade by making the processes more inclusive and efficient. The steam power revolution connected the world like never before. The invention of shipping containers laid the foundation for globalization.


Reinforcement Learning from scratch – Insight Data

#artificialintelligence

Recently, I gave a talk at the O'Reilly AI conference in Beijing about some of the interesting lessons we've learned in the world of NLP. While there, I was lucky enough to attend a tutorial on Deep Reinforcement Learning (Deep RL) from scratch by Unity Technologies. I thought that the session, led by Arthur Juliani, was extremely informative and wanted to share some big takeaways below. In our conversations with companies, we've seen a rise of interesting Deep RL applications, tools and results. In parallel, the inner workings and applications of Deep RL, such as AlphaGo pictured above, can often seem esoteric and hard to understand.


Computer Science Research Is Lacking In These Key Areas

Forbes - Tech

What are some underdeveloped areas in computer science research right now (2018)? Over the past few decades, computer science research, either in industry or academia, has led to ground breaking technology innovations such as the internet, which continues to change our lives. In the post-Moore's Law era, advances in cloud computing affected so many sub-areas of computer science like operating systems and database systems. Furthermore, solid state drives (SSDs) changed the way we design storage systems, which were previously tailored for the mechanical hard drive (HDD). Recently, quantum computing promises lightning-speed calculations as opposed to classic electronics-based computers.


Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICU

arXiv.org Machine Learning

Machine learning approaches have been effective in predicting adverse outcomes in different clinical settings. These models are often developed and evaluated on datasets with heterogeneous patient populations. However, good predictive performance on the aggregate population does not imply good performance for specific groups. In this work, we present a two-step framework to 1) learn relevant patient subgroups, and 2) predict an outcome for separate patient populations in a multi-task framework, where each population is a separate task. We demonstrate how to discover relevant groups in an unsupervised way with a sequence-to-sequence autoencoder. We show that using these groups in a multi-task framework leads to better predictive performance of in-hospital mortality both across groups and overall. We also highlight the need for more granular evaluation of performance when dealing with heterogeneous populations.