We provide a model of the standard watermaze task, and of a more challenging task involving novel platform locations, in which rats exhibit one-trial learning after a few days of training. The model uses hippocampal place cells to support reinforcement learning, and also, in an integrated manner, to build and use allocentric coordinates. 1 INTRODUCTION

We provide a model of the standard watermaze task, and of a more challenging task involving novel platform locations, in which rats exhibit one-trial learning after a few days of training. The model uses hippocampal place cells to support reinforcement learning, and also, in an integrated manner, to build and use allocentric coordinates. 1 INTRODUCTION

Peter Dayan E25-210, MIT Cambridge, MA 02139 We provide a model of the standard watermaze task, and of a more challenging task involving novel platform locations, in which rats exhibit one-trial learning after a few days of training. The model uses hippocampal place cells to support reinforcement learning, and also, in an integrated manner, to build and use allocentric coordinates. 1 INTRODUCTION

This paper introduces AntNet, a novel approach to the adaptive learning of routing tables in communications networks. AntNet is a distributed, mobile agents based Monte Carlo system that was inspired by recent work on the ant colony metaphor for solving optimization problems. AntNet's agents concurrently explore the network and exchange collected information. The communication among the agents is indirect and asynchronous, mediated by the network itself. This form of communication is typical of social insects and is called stigmergy. We compare our algorithm with six state-of-the-art routing algorithms coming from the telecommunications and machine learning fields. The algorithms' performance is evaluated over a set of realistic testbeds. We run many experiments over real and artificial IP datagram networks with increasing number of nodes and under several paradigmatic spatial and temporal traffic distributions. Results are very encouraging. AntNet showed superior performance under all the experimental conditions with respect to its competitors. We analyze the main characteristics of the algorithm and try to explain the reasons for its superiority.

We applied mobile computing to community support and explored mobile computing with a large number of terminals. This article reports on the Second International Conference on Multiagent Systems (ICMAS'96) Mobile Assistant Project that was conducted at an actual international conference for multiagent systems using 100 personal digital assistants (PDAs) and cellular telephones. We supported three types of service: (1) communication services such as e-mail and net news; (2) information services such as conference, personal, and tourist information; and (3) community support services such as forum and meeting arrangements. After the conference, we analyzed a large amount of log data and obtained the following results: It appears that people continuously used PDAs in their hotel rooms after dinner; e-mail services were used independently of the conference structure, but the load on information services reflected the schedule of the conference. Postquestionnaire data showed that our trial was considered interesting, although people were not fully satisfied with the PDAs and services provided. Participants showed a deep interest in mobile computing for community support.

In cellular telephone systems, an important problem is to dynamically allocate the communication resource (channels) so as to maximize service in a stochastic caller environment. This problem is naturally formulated as a dynamic programming problem and we use a reinforcement learning (RL) method to find dynamic channel allocation policies that are better than previous heuristic solutions. The policies obtained perform well for a broad variety of call traffic patterns.

In cellular telephone systems, an important problem is to dynamically allocate the communication resource (channels) so as to maximize service in a stochastic caller environment. This problem is naturally formulated as a dynamic programming problem and we use a reinforcement learning (RL) method to find dynamic channel allocation policies that are better than previous heuristic solutions. The policies obtained perform well for a broad variety of call traffic patterns.

In cellular telephone systems, an important problem is to dynamically allocatethe communication resource (channels) so as to maximize servicein a stochastic caller environment. This problem is naturally formulated as a dynamic programming problem and we use a reinforcement learning (RL) method to find dynamic channel allocation policies that are better than previous heuristic solutions. The policies obtained perform well for a broad variety of call traffic patterns.We present results on a large cellular system with approximately 49

Busey Bank (Champaign, Ill.) is using intelligent-agent technology to launch its Lloyds Bowmaker Motor Finance (Petersfield, U.K.) has implemented a The Philadelphia Stock Exchange care products, has developed a rulebased neural network-based system for credit (Philadelphia, Pa.) has adopted an multinational order-entry and scoring new loan applications. The company is system helps Lloyds determine whether increase the reliability and scalability using the system to process orders to accept a loan and gives the reasons of network-supported options-trading from its network of more than for its choice. The system uses an electronic facilities. The software will permit installed a rule-based expert system to camera to image the front face of letters, team members in different geographic manage the complexity of producing identify the destination address, locations to explore similar multisensory more than 20,000 new designs and and determine its delivery-point bar environments both independently 2.4 billion greeting cards annually. The company has completely reengineered its operation, converting an Telecommunications providers MCI Healthcare software developer HBO & antiquated job-shop operation into a (Washington, D.C.) and BT (London, Company (Atlanta, Ga.) is developing state-of-the-art cellular one.

The system generates traffic flow measurements that enable traffic operations centers to monitor traffic movement and better respond to accidents Wal-Mart Stores (Bentonville, Ark.) Tektronix (Wilsonville, Ore.), a and congestion. This system, which manage its automated storage and models for its computer-assisted includes fuzzy logic and neural network retrieval system. The systems will Mexico), a producer of metals, has Calif.) is using visualization and digital monitor satellite signals in near real implemented an intelligent system to prototyping software for vehicle time, alerting operators to out-of-tolerance improve its zinc yield. The advanced design and manufacturing within its conditions and the presence of control expert system provides operator new concurrent engineering system. The application was developed and virtual manufacturing.