Planning & Scheduling
How AI is helping revolutionize telco service operations
Operations in the telecommunications industry is often said to be one of the most complex aspects of the business to run, and the most successful telcos tend to be those that outperform at this task. It requires a simultaneous, coordinated, and dynamic approach across business units, each of which alone would be a giant business to run. In recent years, artificial intelligence has had the potential to simplify the task by optimizing various functions that make up operations. Telcos are only just beginning to utilize that promise, with operators finding success with AI solutions that help optimize service operations journeys, such as the in-store customer experience, call center use, and deployment of employees in stores, call centers, and the field. The intensely challenging economic landscape that telcos have had to navigate in recent years makes the prospect of investment in new solutions daunting.
Companies Improve Their Supply Chains With Artificial Intelligence
Many large enterprises use one form or another of a supply chain application to help manage their supply chains. Supply chain vendors have been touting their investments in artificial intelligence (AI) for the last several years. Alex Pradhan, Product Strategy Leader John Galt Solutions, told me that "all planning vendors have bold marketing around AI." But the trick is to find suppliers with "field-proven AI/ML algorithms" that "have been delivered at scale." Further, while artificial intelligence helps solve certain types of problems, Jay Muelhoefer - the chief marketing officer at Kinaxis pointed out - optimization and heuristics work better for other types of planning problems. This article, which is focused on the different types of artificial intelligence used and the types of problems they are solving, is aimed at helping practitioners cut through the hype.
Bias in AI and Machine Learning - The AI Journal
As AI and machine learning are becoming popular, Bias in AI decisions is a popular topic for research and focus in academia and industry AI practices. Bias can be specific to age, culture, country, gender, race, and other society-related biases. Bias can be due to a technique or data used for training and testing. Society-related bias creates different perceptions and people might interpret the AI/ML decisions in a wrong way. There is bias created by the AI and Machine learning systems in their decision making as the model learning is based on training and testing data.
A Unified Perspective on Value Backup and Exploration in Monte-Carlo Tree Search
Dam, Tuan, D'Eramo, Carlo, Peters, Jan, Pajarinen, Joni
Monte-Carlo Tree Search (MCTS) is a class of methods for solving complex decision-making problems through the synergy of Monte-Carlo planning and Reinforcement Learning (RL). The highly combinatorial nature of the problems commonly addressed by MCTS requires the use of efficient exploration strategies for navigating the planning tree and quickly convergent value backup methods. These crucial problems are particularly evident in recent advances that combine MCTS with deep neural networks for function approximation. In this work, we propose two methods for improving the convergence rate and exploration based on a newly introduced backup operator and entropy regularization. We provide strong theoretical guarantees to bound convergence rate, approximation error, and regret of our methods. Moreover, we introduce a mathematical framework based on the use of the $\alpha$-divergence for backup and exploration in MCTS. We show that this theoretical formulation unifies different approaches, including our newly introduced ones, under the same mathematical framework, allowing to obtain different methods by simply changing the value of $\alpha$. In practice, our unified perspective offers a flexible way to balance between exploration and exploitation by tuning the single $\alpha$ parameter according to the problem at hand. We validate our methods through a rigorous empirical study from basic toy problems to the complex Atari games, and including both MDP and POMDP problems.
Answer Set Planning: A Survey
Son, Tran Cao, Pontelli, Enrico, Balduccini, Marcello, Schaub, Torsten
Answer Set Planning refers to the use of Answer Set Programming (ASP) to compute plans, i.e., solutions to planning problems, that transform a given state of the world to another state. The development of efficient and scalable answer set solvers has provided a significant boost to the development of ASP-based planning systems. This paper surveys the progress made during the last two and a half decades in the area of answer set planning, from its foundations to its use in challenging planning domains. The survey explores the advantages and disadvantages of answer set planning. It also discusses typical applications of answer set planning and presents a set of challenges for future research.
Using Deep Learning to Bootstrap Abstractions for Hierarchical Robot Planning
Shah, Naman, Srivastava, Siddharth
This paper addresses the problem of learning abstractions that boost robot planning performance while providing strong guarantees of reliability. Although state-of-the-art hierarchical robot planning algorithms allow robots to efficiently compute long-horizon motion plans for achieving user desired tasks, these methods typically rely upon environment-dependent state and action abstractions that need to be hand-designed by experts. We present a new approach for bootstrapping the entire hierarchical planning process. This allows us to compute abstract states and actions for new environments automatically using the critical regions predicted by a deep neural network with an auto-generated robot-specific architecture. We show that the learned abstractions can be used with a novel multi-source bi-directional hierarchical robot planning algorithm that is sound and probabilistically complete. An extensive empirical evaluation on twenty different settings using holonomic and non-holonomic robots shows that (a) our learned abstractions provide the information necessary for efficient multi-source hierarchical planning; and that (b) this approach of learning, abstractions, and planning outperforms state-of-the-art baselines by nearly a factor of ten in terms of planning time on test environments not seen during training.
Task Modifiers for HTN Planning and Acting
Yuan, Weihang, Munoz-Avila, Hector, Gogineni, Venkatsampath Raja, Kondrakunta, Sravya, Cox, Michael, He, Lifang
The ability of an agent to change its objectives in response to unexpected events is desirable in dynamic environments. In order to provide this capability to hierarchical task network (HTN) planning, we propose an extension of the paradigm called task modifiers, which are functions that receive a task list and a state and produce a new task list. We focus on a particular type of problems in which planning and execution are interleaved and the ability to handle exogenous events is crucial. To determine the efficacy of this approach, we evaluate the performance of our task modifier implementation in two environments, one of which is a simulation that differs substantially from traditional HTN domains.
A new perspective on classification: optimally allocating limited resources to uncertain tasks
Vanderschueren, Toon, Baesens, Bart, Verdonck, Tim, Verbeke, Wouter
A central problem in business concerns the optimal allocation of limited resources to a set of available tasks, where the payoff of these tasks is inherently uncertain. In credit card fraud detection, for instance, a bank can only assign a small subset of transactions to their fraud investigations team. Typically, such problems are solved using a classification framework, where the focus is on predicting task outcomes given a set of characteristics. Resources are then allocated to the tasks that are predicted to be the most likely to succeed. However, we argue that using classification to address task uncertainty is inherently suboptimal as it does not take into account the available capacity. Therefore, we first frame the problem as a type of assignment problem. Then, we present a novel solution using learning to rank by directly optimizing the assignment's expected profit given limited, stochastic capacity. This is achieved by optimizing a specific instance of the net discounted cumulative gain, a commonly used class of metrics in learning to rank. Empirically, we demonstrate that our new method achieves higher expected profit and expected precision compared to a classification approach for a wide variety of application areas and data sets. This illustrates the benefit of an integrated approach and of explicitly considering the available resources when learning a predictive model.
Dvorak
AI Planning is inherently hard and hence it is desirable to derive as much information as we can from the structure of the planning problem and let this information be exploited by a planner. Many recent planners use the finite-domain state-variable representation of the problem instead of the traditional propositional representation. However, most planning problems are still specified in the propositional representation due to the widespread modeling language PDDL and it is hard to generate a compact and computationally efficient state variable representation from the propositional model. In this paper we propose a novel method for automaticallygenerating an efficient state-variable representation from the propositional representation. This method groups sets of propositions into state variables based onthe mutex relations introduced in the planning graph. As we shall show experimentally, our method outperforms the current state-of-the-art method both in the smaller number of generated state variables and in the increased performance of planners.
Chrpa
In Automated Planning, learning and exploiting additional knowledge within a domain model, in order to improve plan generation speed-up and increase the scope of problems solved, has attracted much research. Reformulation techniques such as those based on macro-operators or entanglements are very promising because they are to some extent domain model and planning engine independent. This paper aims to exploit recent work on inner entanglements, relations between pairs of planning operators and predicates encapsulating exclusivity of predicate achievements or requirements', for generating macro-operators. We discuss conditions which are necessary for generating such macro-operators and conditions that allow removing primitive operators without compromising solvability of a given (class of) problem(s). The effectiveness of our approach will be experimentally shown on a set of well-known benchmark domains using several high-performing planning engines.