Agents
Towards Con-Resistant Trust Models for Distributed Agent Systems
Salehi-Abari, Amirali (Carleton University) | White, Tony (Carleton University)
Artificial societies โ distributed systems of autonomous agents โ are becoming increasingly important in e-commerce. Agents base their decisions on trust and reputation in ways analogous to human societies. Many different definitions for trust and reputation have been proposed that incorporate many sources of information; however, system designs have tended to focus much of their attention on direct interactions. Furthermore, trust updating schemes for direct interactions have tended to uncouple updates for positive and negative feedback. Consequently, behaviour in which cycles of positive feedback followed by a single negative feedback results in untrustworthy agents remaining undetected. This con-man style of behaviour is formally described and desirable characteristics of con-resistant trust schemes proposed. A con-resistant scheme is proposed and compared with FIRE, Regret and Yu and Singh's model. Simulation experiments demonstrate the utility of the con-resistant scheme.
Modeling Agents through Bounded Rationality Theories
Rosenfeld, Avi (JCT) | Kraus, Sarit (Bar Ilan University)
Effectively modeling an agent's cognitive model is an important problem in many domains. In this paper, we explore the agents people wrote to operate within optimization problems. We claim that the overwhelming majority of these agents used strategies based on bounded rationality, even when optimal solutions could have been implemented. Particularly, we believe that many elements from Aspiration Adaptation Theory (AAT) are useful in quantifying these strategies. To support these claims, we present extensive empirical results from over a hundred agents programmed to perform in optimization problems involving solving for one and two variables.
Coalition Structure Generation in Multi-Agent Systems With Positive and Negative Externalities
Rahwan, Talal (University of Southampton) | Michalak, Tomasz (University of Liverpool) | Jennings, Nicholas (University of Southampton) | Wooldridge, Michael (University of Liverpool) | McBurney, Peter (University of Liverpool)
Coalition structure generation has received considerable attention in recent research. Several algorithms have been proposed to solve this problem in Characteristic Function Games (CFGs), where every coalition is assumed to perform equally well in any coalition structure containing it. In contrast, very little attention has been given to the more general Partition Function Games (PFGs), where a coalition's effectiveness may change from one coalition structure to another. In this paper, we deal with PFGs with positive and negative externalities. In this context, we identify the minimum search that is required in order to establish a bound on the quality of the best coalition structure found. We then develop an anytime algorithm that improves this bound with further search, and show that it outperforms the existing state-of-the-art algorithms by orders of magnitude.
Generalised Fictitious Play for a Continuum of Anonymous Players
Rabinovich, Zinovi (University of Southampton) | Gerding, Enrico (University of Southampton) | Polukarov, Maria (University of Southampton) | Jennings, Nicholas R. (University of Southampton)
Recently, efficient approximation algorithms for finding Nash equilibria have been developed for the interesting class of anonymous games , where a player's utility does not depend on the identity of its opponents. In this paper, we tackle the problem of computing equilibria in such games with continuous player types , extending the framework to encompass settings with imperfect information. In particular, given the existence result for pure Bayes-Nash equilibiria in these games, we generalise the fictitious play algorithm by developing a novel procedure for finding a best response strategy, which is specifically designed to deal with continuous and, therefore, infinite type spaces. We then combine the best response computation with the general fictitious play structure to obtain an equilibrium. To illustrate the power of this approach, we apply our algorithm to the domain of simultaneous auctions with continuous private values and discrete bids, in which the algorithm shows quick convergence.
Thou Shalt Covet Thy Neighbor's Cake
Procaccia, Ariel D. (Microsoft Israel R&D Center)
The problem of fairly dividing a cake (as a metaphor for a heterogeneous divisible good) has been the subject of much interest since the 1940's, and is of importance in multiagent resource allocation. Two fairness criteria are usually considered: proportionality, in the sense that each of the n agents receives at least 1/n of the cake; and the stronger property of envy-freeness, namely that each agent prefers its own piece of cake to the others' pieces. For proportional division, there are algorithms that require O(nlogn) steps, and recent lower bounds imply that one cannot do better. In stark contrast, known (discrete) algorithms for envy-free division require an unbounded number of steps, even when there are only four agents. In this paper, we give an Omega(n 2 ) lower bound for the number of steps required by envy-free cake-cutting algorithms. This result provides, for the first time, a true separation between envy-free and proportional division, thus giving a partial explanation for the notorious difficulty of the former problem.
Strategyproof Classification with Shared Inputs
Meir, Reshef (Hebrew University) | Procaccia, Ariel D. (Microsoft Israel R&D Center) | Rosenschein, Jeffrey S. (Hebrew University)
Strategyproof classification deals with a setting where a decision-maker must classify a set of input points with binary labels, while minimizing the expected error. The labels of the input points are reported by self-interested agents, who might lie in order to obtain a classifier that more closely matches their own labels, thus creating a bias in the data; this motivates the design of truthful mechanisms that discourage false reports. Previous work [Meir et al., 2008] investigated both decision-theoretic and learning-theoretic variations of the setting, but only considered classifiers that belong to a degenerate class. In this paper we assume that the agents are interested in a shared set of input points. We show that this plausible assumption leads to powerful results. In particular, we demonstrate that variations of a truthful random dictator mechanism can guarantee approximately optimal outcomes with respect to any class of classifiers.
Balancing Utility and Deal Probability for Auction-based Negotiations in Highly Nonlinear Utility Spaces
Marsa-Maestre, Ivan (Universidad de Alcala) | Lopez-Carmona, Miguel A. (Universidad de Alcala) | Velasco, Juan R. (Universidad de Alcala) | Ito, Takayuki (MIT Sloan School of Management) | Klein, Mark (MIT Sloan School of Management) | Fujita, Katsuhide (Nagoya Institute of Technology)
Experiments show that these approaches achieve high effectiveness Negotiation scenarios involving nonlinear utility (measured as high optimality rates and low failure rates functions are specially challenging, because traditional for the negotiations) in the evaluation scenario they describe negotiation mechanisms cannot be applied. (Section 2). However, as we will show empirically in Section Even mechanisms designed and proven useful for 5.2, these approaches perform worse as the circumstances of nonlinear utility spaces may fail if the utility space the scenario turn harder (that is, when the utility functions is highly nonlinear. For example, although both are highly nonlinear, like in B2B interactions or distributed contract sampling and constraint sampling have automated control systems). Under these circumstances, the been successfully used in auction based negotiations failure rate increases drastically, raising the need for an alternative with constraint-based utility spaces, they tend approach.
Event-Detecting Multi-Agent MDPs: Complexity and Constant-Factor Approximation
Kumar, Akshat (Umass Amherst) | Zilberstein, Shlomo (Umass Amherst)
Planning under uncertainty for multiple agents has flourished with the development of formal models such as multi-agent MDPs and decentralized MDPs. Despite their richness, applicability of these models remains limited due to their computational complexity. We present the class of event-detecting Multi-agent MDPs (eMMDPs), designed to detect multiple mobile targets by a team of sensor agents. We show that eMMDPs are NP-Hard and present a scalable 2-approximation algorithm for solving them using matroid theory and constraint optimization. Its complexity is linear in the state-space and number of agents, quadratic in the horizon, and exponential only in a small parameter that depends on the interaction among the agents. Despite the worst-case approximation ratio of 2, experimental results show that the algorithm produces nearoptimal policies for a range of test problems.
Exchanging Reputation Information Between Communities: A Payment-Function Approach
Kastidou, Georgia (University of Waterloo) | Larson, Kate (University of Waterloo) | Cohen, Robin (University of Waterloo)
We introduce a framework so that communities can exchange reputation information about agents in environments where agents are migrating between communities. We view the acquisition of the reputation information as a purchase and focus on the design of a payment function to facilitate the payment for information in a way that motivates communities to truthfully report reputation information for agents. We prove that in our proposed framework, honesty is the optimal policy and demonstrate the value of using a payment-function approach for the exchange of reputation information about agents between communities in multiagent environments. Using our payment function, each community is strengthened: it is able to reason more effectively about which agents to accept and can enjoy agents that are motivated to contribute strongly to the benefit of the community.
Collaboration and Shared Plans in the Open World: Studies of Ridesharing
Kamar, Ece (Harvard University) | Horvitz, Eric (Microsoft Research)
We develop and test computational methods for guiding collaboration that demonstrate how shared plans can be created in real-world settings, where agents can be expected to have diverse and varying goals, preferences, and availabilities. The methods are motivated and evaluated in the realm of ridesharing, using GPS logs of commuting data. We consider challenges with coordination among self-interested people aimed at minimizing the cost of transportation and the impact of travel on the environment. We present planning, optimization, and payment mechanisms that provide fair and efficient solutions to the rideshare collaboration challenge. We evaluate different VCG-based payment schemes in terms of their computational efficiency, budget balance, incentive compatibility, and strategy proofness. We present the behavior and analyses provided by the ABC ridesharing prototype system. The system learns about destinations and preferences from GPS traces and calendars, and considers time, fuel, environmental, and cognitive costs. We review how ABC generates rideshare plans from hundreds of real-life GPS traces collected from a community of commuters and reflect about the promise of employing the ABC methods to reduce the number of vehicles on the road, thus reducing CO2 emissions and fuel expenditures.