Communications
Decomposition of Reinforcement Learning for Admission Control of Self-Similar Call Arrival Processes
In multi-service communications networks, such as Asynchronous Transfer Mode (ATM) networks, resource control is of crucial importance for the network operator as well as for the users. The objective is to maintain the service quality while maximizing the operator's revenue. At the call level, service quality (Grade of Service) is measured in terms of call blocking probabilities, and the key resource to be controlled is bandwidth. Network routing and call admission control (CAC) are two such resource control problems. Markov decision processes offer a framework for optimal CAC and routing [1]. By modelling thedynamics of the network with traffic and computing control policies using dynamic programming [2], resource control is optimized. A standard assumption in such models is that calls arrive according to Poisson processes. This makes the models of the dynamics relatively simple. Although the Poisson assumption is valid for most user-initiated requests in communications networks, a number of studies [3, 4, 5] indicate that many types of arrival processesin wide-area networks as well as in local area networks are statistically selfsimilar.
AAAI News
The Council encouraged Science and Engineering Fair, to be sometimes after an appropriate the Conference Committee to gather held May 8-10 in San Jose. Carol asked waiting period agreeable to our copublisher, extensive feedback after the 2002 conference for a volunteer to replace Mel Montemerlo The MIT Press. The Council voted to gauge how well this new as the coordinator of the judging in favor of reaffirming this policy format was received.
Personalized Electronic Program Guides for Digital TV
Although today's world offers us unprecedented access to greater and greater amounts of electronic information, we are faced with significant problems when it comes to finding the right information at the right time -- the essence of the information-overload problem. One of the proposed solutions to this problem is to develop technologies for automatically learning about the implicit and explicit preferences of individual users to customize and personalize the search for relevant information. In this article, we describe the development of the personalized television listings system (PTV),1 which tackles the information-overload problem associated with modern TV listings data by providing an Internet-based personalized TV listings service so that each registered user receives a daily TV guide that has been specially compiled to suit his/her particular viewing preferences.
Knowledge Portals: Ontologies at Work
Staab, Steffen, Maedche, Alexander
Knowledge portals provide views onto domain-specific information on the World Wide Web, thus helping their users find relevant, domain-specific information. The construction of intelligent access and the contribution of information to knowledge portals, however, remained an ad hoc task, requiring extensive manual editing and maintenance by the knowledge portal providers. To diminish these efforts, we use ontologies as a conceptual backbone for providing, accessing, and structuring information in a comprehensive approach for building and maintaining knowledge portals. We present one research study and one commercial case study that show how our approach, called seal (semantic portal), is used in practice.
Low Power Wireless Communication via Reinforcement Learning
This paper examines the application of reinforcement learning to a wireless communicationproblem. The problem requires that channel utility be maximized while simultaneously minimizing battery usage. We present a solution to this multi-criteria problem that is able to significantly reducepower consumption. The solution uses a variable discount factor to capture the effects of battery usage. 1 Introduction Reinforcement learning (RL) has been applied to resource allocation problems in telecommunications, e.g.,channel allocation in wireless systems, network routing, and admission control in telecommunication networks [1,2, 8, 10]. These have demonstrated reinforcement learningcan find good policies that significantly increase the application reward within the dynamics of the telecommunication problems.
Last-Minute Travel Application
Hubner, Andre, Lenz, Mario, Borch, Roman, Posthoff, Michael
In this article, we present a last-minute travel application as part of a complete virtual travel agency. Each year, a significant amount of tour packages are sold as last minute tours in Germany. It is impossible for a travel agent to keep track of all the offered tour packages. Electronic-commerce applications might present the best possible tour package for a specific customer request. Traditional database-driven applications, as used by most of the tour operators, are not sufficient enough to implement a sales process with consultation on the World Wide Web. The last-minute travel application presented here uses case-based reasoning to bridge this gap and simulate the sales assistance of a human travel agent. A case retrieval net, as an internal data structure, proved to be efficient in handling the large amount of data. Important for the acceptance by customers is also the integration into the virtual travel agency and the interconnections to other parts of this system, such as background information or the online car rental application.
The Road Ahead for Knowledge Management: An AI Perspective
Smith, Reid G., Farquhar, Adam
Enabling organizations to capture, share, and apply the collective experience and know-how of their people is seen as fundamental to competing in the knowledge economy. As a result, there has been a wave of enthusiasm and activity centered on knowledge management. To make progress in this area, issues of technology, process, people, and content must be addressed. In this article, we develop a road map for knowledge management. It begins with an assessment of the current state of the practice, using examples drawn from our experience at Schlumberger. It then sketches the possible evolution of technology and practice over a 10-year period. Along the way, we highlight ways in which AI technology, present and future, can be applied in knowledge management systems.
Using Collective Intelligence to Route Internet Traffic
Wolpert, David, Tumer, Kagan, Frank, Jeremy
A COllective INtelligence (COIN) is a set of interacting reinforcement learning (RL) algorithms designed in an automated fashion so that their collective behavior optimizes a global utility function. We summarize the theory of COINs, then present experiments using that theory to design COINs to control internet traffic routing. These experiments indicate that COINs outperform all previously investigated RL-based, shortest path routing algorithms. 1 INTRODUCTION COllective INtelligences (COINs) are large, sparsely connected recurrent neural networks, whose "neurons" are reinforcement learning (RL) algorithms. The distinguishing feature of COINs is that their dynamics involves no centralized control, but only the collective effects of the individual neurons each modifying their behavior via their individual RL algorithms. This restriction holds even though the goal of the COIN concerns the system's global behavior.
Call-Based Fraud Detection in Mobile Communication Networks Using a Hierarchical Regime-Switching Model
Hollmén, Jaakko, Tresp, Volker
Fraud causes substantial losses to telecommunication carriers. Detection systems which automatically detect illegal use of the network can be used to alleviate the problem. Previous approaches worked on features derived from the call patterns of individual users. In this paper we present a call-based detection system based on a hierarchical regime-switching model. The detection problem is formulated as an inference problem on the regime probabilities.