Jonker, Catholijn
Improving Confidence in the Estimation of Values and Norms
Siebert, Luciano Cavalcante, Mercuur, Rijk, Dignum, Virginia, Hoven, Jeroen van den, Jonker, Catholijn
Autonomous agents (AA) will increasingly be interacting with us in our daily lives. While we want the benefits attached to AAs, it is essential that their behavior is aligned with our values and norms. Hence, an AA will need to estimate the values and norms of the humans it interacts with, which is not a straightforward task when solely observing an agent's behavior. This paper analyses to what extent an AA is able to estimate the values and norms of a simulated human agent (SHA) based on its actions in the ultimatum game. We present two methods to reduce ambiguity in profiling the SHAs: one based on search space exploration and another based on counterfactual analysis. We found that both methods are able to increase the confidence in estimating human values and norms, but differ in their applicability, the latter being more efficient when the number of interactions with the agent is to be minimized. These insights are useful to improve the alignment of AAs with human values and norms.
The Workshop Program at the Nineteenth National Conference on Artificial Intelligence
Muslea, Ion, Dignum, Virginia, Corkill, Daniel, Jonker, Catholijn, Dignum, Frank, Coradeschi, Silvia, Saffiotti, Alessandro, Fu, Dan, Orkin, Jeff, Cheetham, William E., Goebel, Kai, Bonissone, Piero, Soh, Leen-Kiat, Jones, Randolph M., Wray, Robert E., Scheutz, Matthias, Farias, Daniela Pucci de, Mannor, Shie, Theocharou, Georgios, Precup, Doina, Mobasher, Bamshad, Anand, Sarabjot Singh, Berendt, Bettina, Hotho, Andreas, Guesgen, Hans, Rosenstein, Michael T., Ghavamzadeh, Mohammad
AAAI presented the AAAI-04 workshop program on July 25-26, 2004 in San Jose, California. This program included twelve workshops covering a wide range of topics in artificial intelligence. The titles of the workshops were as follows: (1) Adaptive Text Extraction and Mining; (2) Agent Organizations: Theory and Practice; (3) Anchoring Symbols to Sensor Data; (4) Challenges in Game AI; (5) Fielding Applications of Artificial Intelligence; (6) Forming and Maintaining Coalitions in Adaptive Multiagent Systems; (7) Intelligent Agent Architectures: Combining the Strengths of Software Engineering and Cognitive Systems; (8) Learning and Planning in Markov Processes -- Advances and Challenges; (9) Semantic Web Personalization; (10) Sensor Networks; (11) Spatial and Temporal Reasoning; and (12) Supervisory Control of Learning and Adaptive Systems.
The Workshop Program at the Nineteenth National Conference on Artificial Intelligence
Muslea, Ion, Dignum, Virginia, Corkill, Daniel, Jonker, Catholijn, Dignum, Frank, Coradeschi, Silvia, Saffiotti, Alessandro, Fu, Dan, Orkin, Jeff, Cheetham, William E., Goebel, Kai, Bonissone, Piero, Soh, Leen-Kiat, Jones, Randolph M., Wray, Robert E., Scheutz, Matthias, Farias, Daniela Pucci de, Mannor, Shie, Theocharou, Georgios, Precup, Doina, Mobasher, Bamshad, Anand, Sarabjot Singh, Berendt, Bettina, Hotho, Andreas, Guesgen, Hans, Rosenstein, Michael T., Ghavamzadeh, Mohammad
AAAI presented the AAAI-04 workshop program on July 25-26, 2004 in San Jose, California. This program included twelve workshops covering a wide range of topics in artificial intelligence. The titles of the workshops were as follows: (1) Adaptive Text Extraction and Mining; (2) Agent Organizations: Theory and Practice; (3) Anchoring Symbols to Sensor Data; (4) Challenges in Game AI; (5) Fielding Applications of Artificial Intelligence; (6) Forming and Maintaining Coalitions in Adaptive Multiagent Systems; (7) Intelligent Agent Architectures: Combining the Strengths of Software Engineering and Cognitive Systems; (8) Learning and Planning in Markov Processes -- Advances and Challenges; (9) Semantic Web Personalization; (10) Sensor Networks; (11) Spatial and Temporal Reasoning; and (12) Supervisory Control of Learning and Adaptive Systems.