Commonwealth Scientific and Industrial Research Organisation
Fast-Tracking Stationary MOMDPs for Adaptive Management Problems
Péron, Martin (Queensland University of Technology, CSIRO) | Becker, Kai Helge (University of Strathclyde) | Bartlett, Peter (University of California, Berkeley) | Chadès, Iadine (Commonwealth Scientific and Industrial Research Organisation)
Adaptive management is applied in conservation and natural resource management, and consists of making sequential decisions when the transition matrix is uncertain. Informally described as ’learning by doing’, this approach aims to trade off between decisions that help achieve the objective and decisions that will yield a better knowledge of the true transition matrix. When the true transition matrix is assumed to be an element of a finite set of possible matrices, solving a mixed observability Markov decision process (MOMDP) leads to an optimal trade-off but is very computationally demanding. Under the assumption (common in adaptive management) that the true transition matrix is stationary, we propose a polynomial-time algorithm to find a lower bound of the value function. In the corners of the domain of the value function (belief space), this lower bound is provably equal to the optimal value function. We also show that under further assumptions, it is a linear approximation of the optimal value function in a neighborhood around the corners. We evaluate the benefits of our approach by using it to initialize the solvers MO-SARSOP and Perseus on a novel computational sustainability problem and a recent adaptive management data challenge. Our approach leads to an improved initial value function and translates into significant computational gains for both solvers.
Extracting Highly Effective Features for Supervised Learning via Simultaneous Tensor Factorization
Verma, Sunny (University Of Technology, Sydney) | Liu, Wei (University of Technology, Sydney) | Wang, Chen (Commonwealth Scientific and Industrial Research Organisation) | Zhu, Liming (Commonwealth Scientific and Industrial Research Organisation)
Real world data is usually generated over multiple time periods associated with multiple labels, which can be represented as multiple labeled tensor sequences. These sequences are linked together, sharing some common features while exhibiting their own unique features. Conventional tensor factorization techniques are limited to extract either common or unique features, but not both simultaneously. However, both types of these features are important in many machine learning systems as they inherently affect the systems' performance. In this paper, we propose a novel supervised tensor factorization technique which simultaneously extracts ordered common and unique features. Classification results using features extracted by our method on CIFAR-10 database achieves significantly better performance over other factorization methods, illustrating the effectiveness of the proposed technique.
Reports on the 2015 AAAI Workshop Program
Albrecht, Stefano V. (University of Edinburgh) | Beck, J. Christopher (University of Toronto) | Buckeridge, David L. (McGill University) | Botea, Adi (IBM Research, Dublin) | Caragea, Cornelia (University of North Texas) | Chi, Chi-hung (Commonwealth Scientific and Industrial Research Organisation) | Damoulas, Theodoros (New York University) | Dilkina, Bistra (Georgia Institute of Technology) | Eaton, Eric (University of Pennsylvania) | Fazli, Pooyan (Carnegie Mellon University) | Ganzfried, Sam (Carnegie Mellon University) | Giles, C. Lee (Pennsylvania State University) | Guillet, Sébastian (Université du Québec) | Holte, Robert (University of Alberta) | Hutter, Frank (University of Freiburg) | Koch, Thorsten (TU Berlin) | Leonetti, Matteo (University of Texas at Austin) | Lindauer, Marius (University of Freiburg) | Machado, Marlos C. (University of Alberta) | Malitsky, Yui (IBM Research) | Marcus, Gary (New York University) | Meijer, Sebastiaan (KTH Royal Institute of Technology) | Rossi, Francesca (University of Padova, Italy) | Shaban-Nejad, Arash (University of California, Berkeley) | Thiebaux, Sylvie (Australian National University) | Veloso, Manuela (Carnegie Mellon University) | Walsh, Toby (NICTA) | Wang, Can (Commonwealth Scientific and Industrial Research Organisation) | Zhang, Jie (Nanyang Technological University) | Zheng, Yu (Microsoft Research)
AAAI's 2015 Workshop Program was held Sunday and Monday, January 25–26, 2015 at the Hyatt Regency Austin Hotel in Austion, Texas, USA. The AAAI-15 workshop program included 15 workshops covering a wide range of topics in artificial intelligence. Most workshops were held on a single day. The titles of the workshops included AI and Ethics, AI for Cities, AI for Transportation: Advice, Interactivity and Actor Modeling, Algorithm Configuration, Artificial Intelligence Applied to Assistive Technologies and Smart Environments, Beyond the Turing Test, Computational Sustainability, Computer Poker and Imperfect Information, Incentive and Trust in E-Communities, Multiagent Interaction without Prior Coordination, Planning, Search, and Optimization, Scholarly Big Data: AI Perspectives, Challenges, and Ideas, Trajectory-Based Behaviour Analytics, World Wide Web and Public Health Intelligence, Knowledge, Skill, and Behavior Transfer in Autonomous Robots, and Learning for General Competency in Video Games.
Reports on the 2015 AAAI Workshop Program
Albrecht, Stefano V. (University of Edinburgh) | Beck, J. Christopher (University of Toronto) | Buckeridge, David L. (McGill University) | Botea, Adi (IBM Research, Dublin) | Caragea, Cornelia (University of North Texas) | Chi, Chi-hung (Commonwealth Scientific and Industrial Research Organisation) | Damoulas, Theodoros (New York University) | Dilkina, Bistra (Georgia Institute of Technology) | Eaton, Eric (University of Pennsylvania) | Fazli, Pooyan (Carnegie Mellon University) | Ganzfried, Sam (Carnegie Mellon University) | Giles, C. Lee (Pennsylvania State University) | Guillet, Sébastian (Université du Québec) | Holte, Robert (University of Alberta) | Hutter, Frank (University of Freiburg) | Koch, Thorsten (TU Berlin) | Leonetti, Matteo (University of Texas at Austin) | Lindauer, Marius (University of Freiburg) | Machado, Marlos C. (University of Alberta) | Malitsky, Yui (IBM Research) | Marcus, Gary (New York University) | Meijer, Sebastiaan (KTH Royal Institute of Technology) | Rossi, Francesca (University of Padova, Italy) | Shaban-Nejad, Arash (University of California, Berkeley) | Thiebaux, Sylvie (Australian National University) | Veloso, Manuela (Carnegie Mellon University) | Walsh, Toby (NICTA) | Wang, Can (Commonwealth Scientific and Industrial Research Organisation) | Zhang, Jie (Nanyang Technological University) | Zheng, Yu (Microsoft Research)
AAAI's 2015 Workshop Program was held Sunday and Monday, January 25–26, 2015 at the Hyatt Regency Austin Hotel in Austion, Texas, USA. The AAAI-15 workshop program included 15 workshops covering a wide range of topics in artificial intelligence. Most workshops were held on a single day. The titles of the workshops included AI and Ethics, AI for Cities, AI for Transportation: Advice, Interactivity and Actor Modeling, Algorithm Configuration, Artificial Intelligence Applied to Assistive Technologies and Smart Environments, Beyond the Turing Test, Computational Sustainability, Computer Poker and Imperfect Information, Incentive and Trust in E-Communities, Multiagent Interaction without Prior Coordination, Planning, Search, and Optimization, Scholarly Big Data: AI Perspectives, Challenges, and Ideas, Trajectory-Based Behaviour Analytics, World Wide Web and Public Health Intelligence, Knowledge, Skill, and Behavior Transfer in Autonomous Robots, and Learning for General Competency in Video Games.