Goto

Collaborating Authors

 Agents


Agent-Mediated Social Choice

arXiv.org Artificial Intelligence

Computational studies of voting are mostly motivated by two intended applications: the coordination of societies of artificial agents, and the study of human collective decisions whose complexity requires the use of computational techniques. Both research directions are too often confined to theoretical studies, with unrealistic assumptions constraining their significance for real-world situations. Most practical applications of these results are therefore confined to low-stakes decisions, which are of great importance in expanding the use of algorithms in society, but are far from high-stakes choices such as political elections, referenda, or parliamentary decisions, which societies still make using old-fashioned technologies like paper ballots. In this paper I argue in favour of conceiving "voting avatars", artificial agents that are able to act as proxies for voters in collective decisions at any level of society. Besides being an ideal test-bed for a large number of techniques developed in the field of multiagent systems and artificial intelligence in general, agent-mediated social choice may also suggests innovative solutions to the low voter participation that is endemic in most practical implementations of electronic decision processes.


Facing Multiple Attacks in Adversarial Patrolling Games with Alarmed Targets

arXiv.org Artificial Intelligence

We focus on adversarial patrolling games on arbitrary graphs, where the Defender can control a mobile resource, the targets are alarmed by an alarm system, and the Attacker can observe the actions of the mobile resource of the Defender and perform different attacks exploiting multiple resources. This scenario can be modeled as a zero-sum extensive-form game in which each player can play multiple times. The game tree is exponentially large both in the size of the graph and in the number of attacking resources. We show that when the number of the Attacker's resources is free, the problem of computing the equilibrium path is NP-hard, while when the number of resources is fixed, the equilibrium path can be computed in poly-time. We provide a dynamic-programming algorithm that, given the number of the Attacker's resources, computes the equilibrium path requiring poly-time in the size of the graph and exponential time in the number of the resources. Furthermore, since in real-world scenarios it is implausible that the Defender knows the number of attacking resources, we study the robustness of the Defender's strategy when she makes a wrong guess about that number. We show that even the error of just a single resource can lead to an arbitrary inefficiency, when the inefficiency is defined as the ratio of the Defender's utilities obtained with a wrong guess and a correct guess. However, a more suitable definition of inefficiency is given by the difference of the Defender's utilities: this way, we observe that the higher the error in the estimation, the higher the loss for the Defender. Then, we investigate the performance of online algorithms when no information about the Attacker's resources is available. Finally, we resort to randomized online algorithms showing that we can obtain a competitive factor that is twice better than the one that can be achieved by any deterministic online algorithm.


How to Maximize the Spread of Social Influence: A Survey

arXiv.org Artificial Intelligence

This survey presents the main results achieved for the influence maximization problem in social networks. This problem is well studied in the literature and, thanks to its recent applications, some of which currently deployed on the field, it is receiving more and more attention in the scientific community. The problem can be formulated as follows: given a graph, with each node having a certain probability of influencing its neighbors, select a subset of vertices so that the number of nodes in the network that are influenced is maximized. Starting from this model, we introduce the main theoretical developments and computational results that have been achieved, taking into account different diffusion models describing how the information spreads throughout the network, various ways in which the sources of information could be placed, and how to tackle the problem in the presence of uncertainties affecting the network. Finally, we present one of the main application that has been developed and deployed exploiting tools and techniques previously discussed.


Beyond Local Nash Equilibria for Adversarial Networks

arXiv.org Machine Learning

Save for some special cases, current training methods for Generative Adversarial Networks (GANs) are at best guaranteed to converge to a `local Nash equilibrium` (LNE). Such LNEs, however, can be arbitrarily far from an actual Nash equilibrium (NE), which implies that there are no guarantees on the quality of the found generator or classifier. This paper proposes to model GANs explicitly as finite games in mixed strategies, thereby ensuring that every LNE is an NE. With this formulation, we propose a solution method that is proven to monotonically converge to a resource-bounded Nash equilibrium (RB-NE): by increasing computational resources we can find better solutions. We empirically demonstrate that our method is less prone to typical GAN problems such as mode collapse, and produces solutions that are less exploitable than those produced by GANs and MGANs, and closely resemble theoretical predictions about NEs.


A unified strategy for implementing curiosity and empowerment driven reinforcement learning

arXiv.org Artificial Intelligence

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism capable of quantifying and controlling the evolution of the information flow between the agent and the environment could be the fundamental component for implementing a higher degree of autonomy into artificial intelligent agents. This paper propose a unified strategy for implementing two semantically orthogonal intrinsic motivations: curiosity and empowerment. Curiosity reward informs the agent about the relevance of a recent agent action, whereas empowerment is implemented as the opposite information flow from the agent to the environment that quantifies the agent's potential of controlling its own future. We show that an additional homeostatic drive is derived from the curiosity reward, which generalizes and enhances the information gain of a classical curious/heterostatic reinforcement learning agent. We show how a shared internal model by curiosity and empowerment facilitates a more efficient training of the empowerment function. Finally, we discuss future directions for further leveraging the interplay between these two intrinsic rewards.


Learning Policy Representations in Multiagent Systems

arXiv.org Artificial Intelligence

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We propose a general learning framework for modeling agent behavior in any multiagent system using only a handful of interaction data. Our framework casts agent modeling as a representation learning problem. Consequently, we construct a novel objective inspired by imitation learning and agent identification and design an algorithm for unsupervised learning of representations of agent policies. We demonstrate empirically the utility of the proposed framework in (i) a challenging high-dimensional competitive environment for continuous control and (ii) a cooperative environment for communication, on supervised predictive tasks, unsupervised clustering, and policy optimization using deep reinforcement learning.


Here's who's going to win the World Cup, according to A.I.

#artificialintelligence

Robots aren't playing professional soccer just yet, but they can certainly help predict it! With the FIFA World Cup kicking off, San Francisco-based tech firm Unanimous A.I. has used its considerable artificial intelligence expertise to predict the outcome of the 32-team men's soccer tournament. Given that the startup has previously predicted the Super Bowl results successfully right down to the exact final score, we totally think this is worth taking seriously. "These predictions were generated using swarm A.I. technology," Louis Rosenberg, founder and CEO of Unanimous A.I., told Digital Trends. "This means it uses a unique combination of human insights and artificial intelligence algorithms, resulting in a system that is smarter than the humans or the machines could be on their own. It works by connecting a group of people over the internet using A.I. algorithms, enabling them to think together as a system, and converge upon predictions that are the optimized combination of their individual knowledge, wisdom, instincts, and intuitions."


PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review

arXiv.org Machine Learning

We consider the problem of automated assignment of papers to reviewers in conference peer review, with a focus on fairness and statistical accuracy. Our fairness objective is to maximize the review quality of the most disadvantaged paper, in contrast to the commonly used objective of maximizing the total quality over all papers. We design an assignment algorithm based on an incremental max-flow procedure that we prove is near-optimally fair. Our statistical accuracy objective is to ensure correct recovery of the papers that should be accepted. We provide a sharp minimax analysis of the accuracy of the peer-review process for a popular objective-score model as well as for a novel subjective-score model that we propose in the paper. Our analysis proves that our proposed assignment algorithm also leads to a near-optimal statistical accuracy. Finally, we design a novel experiment that allows for an objective comparison of various assignment algorithms, and overcomes the inherent difficulty posed by the absence of a ground truth in experiments on peer-review. The results of this experiment corroborate the theoretical guarantees of our algorithm.


Spoiler Alert: This A.I. Startup Already Knows Who's Going to Win the World Cup

#artificialintelligence

The World Cup 2018 has officially begun--which means, if you're a hardcore soccer fan, you're pretty tied up for the next month watching the matches. For those who can't or don't want to follow the action, here's a major spoiler: Germany is going to beat Vegas-favorite Brazil in the final, and Spain and France will round out the tournament's final four teams. That prediction comes courtesy of Unanimous A.I., an artificial intelligence startup that performs a kind of complex crowdsourcing. Founded by scientist and engineer Louis Rosenberg, Unanimous can be used to better understand the nuanced opinions of a population, which makes it useful for tasks like performing market research, diagnosing diseases, or making predictions about the future. Launched in 2014, the company's technology already has an impressive résumé of accurate forecasts.


Data-Driven Decentralized Optimal Power Flow

arXiv.org Artificial Intelligence

The implementation of optimal power flow (OPF) methods to perform voltage and power flow regulation in electric networks is generally believed to require communication. We consider distribution systems with multiple controllable Distributed Energy Resources (DERs) and present a data-driven approach to learn control policies for each DER to reconstruct and mimic the solution to a centralized OPF problem from solely locally available information. Collectively, all local controllers closely match the centralized OPF solution, providing near-optimal performance and satisfaction of system constraints. A rate distortion framework facilitates the analysis of how well the resulting fully decentralized control policies are able to reconstruct the OPF solution. Our methodology provides a natural extension to decide what buses a DER should communicate with to improve the reconstruction of its individual policy. The method is applied on both single- and three-phase test feeder networks using data from real loads and distributed generators. It provides a framework for Distribution System Operators to efficiently plan and operate the contributions of DERs to active distribution networks.