Goto

Collaborating Authors

 Oceania


Signature in Counterparts, a Formal Treatment

arXiv.org Artificial Intelligence

"Smart contracts" are a form of code, in the context of cryptocurrency and blockchain platforms, that is used to enforce security properties of multi-agent protocols. Often these protocols are for processes for which trust amongst the agents would typically have been provided through the use of legal contracts. The emergence of the area of "smart contracts" has given renewed motivation to study the formal representation of legal reasoning and legal processes. In the present paper, we consider questions of knowledge representation pertinent to a particular legal process: contract signature. In formation of legal contracts between two or more parties, all parties to the contract are required to sign in order for the contract to be considered valid. In some sensitive situations, this requires a physical meeting of the parties so that copies of the contract can be signed and immediately exchanged for co-signature. An example of such a sensitive situation is where one party may gain advantage in a negotiation with a third party by presentation of a partially signed contract. It is also frequently desirable to establish a state of common knowledge amongst the parties that the contract has been signed and that the signers were authenticated: a physical signing ceremony achieves this goal.


Unsupervised Question Decomposition for Question Answering

arXiv.org Artificial Intelligence

We aim to improve question answering (QA) by decomposing hard questions into easier sub-questions that existing QA systems can answer. Since collecting labeled decompositions is cumbersome, we propose an unsupervised approach to produce sub-questions. Specifically, by leveraging >10M questions from Common Crawl, we learn to map from the distribution of multi-hop questions to the distribution of single-hop sub-questions. We answer sub-questions with an off-the-shelf QA model and incorporate the resulting answers in a downstream, multi-hop QA system. On a popular multi-hop QA dataset, HotpotQA, we show large improvements over a strong baseline, especially on adversarial and out-of-domain questions. Our method is generally applicable and automatically learns to decompose questions of different classes, while matching the performance of decomposition methods that rely heavily on hand-engineering and annotation.


Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach

arXiv.org Machine Learning

In this paper, we design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed to improve the data freshness and connectivity to the Internet of Things (IoT) devices. First, we formulate an energy-efficient trajectory optimization problem in which the objective is to maximize the energy efficiency by optimizing the UAV-BS trajectory policy. We also incorporate different contextual information such as energy and age of information (AoI) constraints to ensure the data freshness at the ground BS. Second, we propose an agile deep reinforcement learning with experience replay model to solve the formulated problem concerning the contextual constraints for the UAV-BS navigation. Moreover, the proposed approach is well-suited for solving the problem, since the state space of the problem is extremely large and finding the best trajectory policy with useful contextual features is too complex for the UAV-BSs. By applying the proposed trained model, an effective real-time trajectory policy for the UAV-BSs captures the observable network states over time. Finally, the simulation results illustrate the proposed approach is 3.6% and 3.13% more energy efficient than those of the greedy and baseline deep Q Network (DQN) approaches.


Robustness to Programmable String Transformations via Augmented Abstract Training

arXiv.org Machine Learning

Deep neural networks for natural language processing tasks are vulnerable to adversarial input perturbations. In this paper, we present a versatile language for programmatically specifying string transformations -- e.g., insertions, deletions, substitutions, swaps, etc. -- that are relevant to the task at hand. We then present an approach to adversarially training models that are robust to such user-defined string transformations. Our approach combines the advantages of search-based techniques for adversarial training with abstraction-based techniques. Specifically, we show how to decompose a set of user-defined string transformations into two component specifications, one that benefits from search and another from abstraction. We use our technique to train models on the AG and SST2 datasets and show that the resulting models are robust to combinations of user-defined transformations mimicking spelling mistakes and other meaning-preserving transformations.


It's Not What Machines Can Learn, It's What We Cannot Teach

arXiv.org Machine Learning

Can deep neural networks learn to solve any task, and in particular problems of high complexity? This question attracts a lot of interest, with recent works tackling computationally hard tasks such as the traveling salesman problem and satisfiability. In this work we offer a different perspective on this question. Given the common assumption that $\textit{NP} \neq \textit{coNP}$ we prove that any polynomial-time sample generator for an $\textit{NP}$-hard problem samples, in fact, from an easier sub-problem. We empirically explore a case study, Conjunctive Query Containment, and show how common data generation techniques generate biased datasets that lead practitioners to over-estimate model accuracy. Our results suggest that machine learning approaches that require training on a dense uniform sampling from the target distribution cannot be used to solve computationally hard problems, the reason being the difficulty of generating sufficiently large and unbiased training sets.


Stochastic Latent Residual Video Prediction

arXiv.org Machine Learning

Designing video prediction models that account for the inherent uncertainty of the future is challenging. Most works in the literature are based on stochastic image-autoregressive recurrent networks, which raises several performance and applicability issues. An alternative is to use fully latent temporal models which untie frame synthesis and temporal dynamics. However, no such model for stochastic video prediction has been proposed in the literature yet, due to design and training difficulties. In this paper, we overcome these difficulties by introducing a novel stochastic temporal model whose dynamics are governed in a latent space by a residual update rule. This first-order scheme is motivated by discretization schemes of differential equations. It naturally models video dynamics as it allows our simpler, more interpretable, latent model to outperform prior state-of-the-art methods on challenging datasets.


An Investigation of Interpretability Techniques for Deep Learning in Predictive Process Analytics

arXiv.org Machine Learning

This paper explores interpretability techniques for two of the most successful learning algorithms in medical decision-making literature: deep neural networks and random forests. We applied these algorithms in a real-world medical dataset containing information about patients with cancer, where we learn models that try to predict the type of cancer of the patient, given their set of medical activity records. We explored different algorithms based on neural network architectures using long short term deep neural networks, and random forests. Since there is a growing need to provide decision-makers understandings about the logic of predictions of black boxes, we also explored different techniques that provide interpretations for these classifiers. In one of the techniques, we intercepted some hidden layers of these neural networks and used autoencoders in order to learn what is the representation of the input in the hidden layers. In another, we investigated an interpretable model locally around the random forest's prediction. Results show learning an interpretable model locally around the model's prediction leads to a higher understanding of why the algorithm is making some decision. Use of local and linear model helps identify the features used in prediction of a specific instance or data point. We see certain distinct features used for predictions that provide useful insights about the type of cancer, along with features that do not generalize well. In addition, the structured deep learning approach using autoencoders provided meaningful prediction insights, which resulted in the identification of nonlinear clusters correspondent to the patients' different types of cancer.


A characterization of proportionally representative committees

arXiv.org Artificial Intelligence

When voters elicit ranked preferences over candidates, one particular axiom for proportional representation is Proportionality of Solid Coalitions (PSC). This axiom was advocated by Dummett [4] and has been referred to as the most important requirement for proportional representation [15, 16, 18, 19]. PSC is the subject of many theoretical and empirical studies. Theoretical studies have focused on designing voting rules that satisfy PSC; these include single transferable vote (STV) [15], Quota Borda System (QBS) [4], Schulz-STV [14], and the Expanding Approvals Rule (EAR) [2].


Artificial Intelligence Innovation - top 15 countries 1990 - 2020

#artificialintelligence

Publications, citations, conference papers, awards, patents and investment are all indicators of innovation in a given field. While there is no perfect measure, we chose the peer-reviewed publications in AI journals as a compromise between history of data, completeness, reliability and coherence. This video shows the trends of artificial intelligence innovation worldwide by country based on this measure, from the AI Index report 2019. Artificial intelligence, machine learning and deep learning in particular are transforming all industries enabling people to perform tasks better and faster, make better decisions, optimizing processes, or automating tasks among others. With the fast growth in compute power and data availability, complex algorithms can learn and extract information from huge amounts of data - big data - that humans cannot.


Deep Multi-Facial Patches Aggregation Network For Facial Expression Recognition

arXiv.org Artificial Intelligence

In this paper, we propose an approach for Facial Expressions Recognition (FER) based on a deep multi-facial patches aggregation network. Deep features are learned from facial patches using deep sub-networks and aggregated within one deep architecture for expression classification . Several problems may affect the performance of deep-learning based FER approaches, in particular, the small size of existing FER datasets which might not be sufficient to train large deep learning networks. Moreover, it is extremely time-consuming to collect and annotate a large number of facial images. To account for this, we propose two data augmentation techniques for facial expression generation to expand FER labeled training datasets. We evaluate the proposed framework on three FER datasets. Results show that the proposed approach achieves state-of-art FER deep learning approaches performance when the model is trained and tested on images from the same dataset. Moreover, the proposed data augmentation techniques improve the expression recognition rate, and thus can be a solution for training deep learning FER models using small datasets. The accuracy degrades significantly when testing for dataset bias.