We study the process of multi-agent reinforcement learning in the context ofload balancing in a distributed system, without use of either centralcoordination or explicit communication. We first define a precise frameworkin which to study adaptive load balancing, important features of which are itsstochastic nature and the purely local information available to individualagents. Given this framework, we show illuminating results on the interplaybetween basic adaptive behavior parameters and their effect on systemefficiency. We then investigate the properties of adaptive load balancing inheterogeneous populations, and address the issue of exploration vs.exploitation in that context. Finally, we show that naive use ofcommunication may not improve, and might even harm system efficiency.

We present algorithms that learn certain classes of function-free recursive logic programs in polynomial time from equivalence queries. In particular, we show that a single k-ary recursive constant-depth determinate clause is learnable. Two-clause programs consisting of one learnable recursive clause and one constant-depth determinate non-recursive clause are also learnable, if an additional ``basecase'' oracle is assumed. These results immediately imply the pac-learnability of these classes. Although these classes of learnable recursive programs are very constrained, it is shown in a companion paper that they are maximally general, in that generalizing either class in any natural way leads to a computationally difficult learning problem. Thus, taken together with its companion paper, this paper establishes a boundary of efficient learnability for recursive logic programs.

Interactive simulation environments constitute one of today's promising emerging technologies, with applications in areas such as education, manufacturing, entertainment, and training. These environments are also rich domains for building and investigating intelligent automated agents, with requirements for the integration of a variety of agent capabilities but without the costs and demands of low-level perceptual processing or robotic control. Our current target is intelligent automated pilots for battlefield-simulation environments. This article provides an overview of this domain and project by analyzing the challenges that automated pilots face in battlefield simulations, describing how TacAir-Soar is successfully able to address many of them -- TacAir-Soar pilots have already successfully participated in constrained air-combat simulations against expert human pilots -- and discussing the issues involved in resolving the remaining research challenges.

The vertical launch system (vls) tech-assist expert system is being used by the in-service engineering agent as a force multiplier to maintain the readiness, with fewer resources, of a growing population of vlss in the U.S. Navy fleet. This article describes the collaborative development of this knowledge-based system for diagnosis; its main features, including case-based and model-based reasoning; and the lessons we learned from the process.

Countrywide loan-underwriting expert system (clues) is an advanced, automated mortgage-underwriting rule-based expert system. The system receives selected information from the loan application, credit report, and appraisal. It then decides whether the loan should be approved or whether it requires further review by a human underwriter. If the system approves the loan, no further review is required, and the application is funded.

The vertical launch system (vls) tech-assist expert system is being used by the in-service engineering agent as a force multiplier to maintain the readiness, with fewer resources, of a growing population of vlss in the U.S. Navy fleet. This article describes the collaborative development of this knowledge-based system for diagnosis; its main features, including case-based and model-based reasoning; and the lessons we learned from the process.

Hughes Missile Systems (Tucson, Lear Astronics (Santa Monica and to "enter" the surgical area, as if they Ariz.) is providing intelligent character Ontario, Calif.) is combining neural were actually there. Cross/Blue Shield (New York, N.Y.) to enhance its Autonomous Landing FuziWare (Knoxville, Tenn.), a developer expedite the processing of medical Guidance (ALG) system. Empire will install the is using a neural network-based tools for business and engineering ICRs at its Yorktown Heights and massively parallel coprocessor for solutions, has received a patent from Manhattan offices, where they will be real-time image processing in the the U.S. Department of Commerce ALG system, which enables commercial Patent and Trademark Office for its used to process about 10,000 documents and military aircraft pilots to FuziCalc product, a fuzzy spreadsheet per day. The claims in the patent cover various fuzzy number The Boston Museum of Fine Arts Researchers at Georgia Tech (Atlanta, interface elements as well as the (Boston, Mass.) has developed a virtual Ga.) have created intelligent agent entire fuzzy number processing system. TOAK navigates and surgical equipment, has implemented through multiple networks and a virtual reality application a complex 3D model derived from across diverse computer systems to for technical design presentation.

's central purpose is to find the most The use of composite materials, Composite part fabrication requires two especially in aerospace applications, is on the major steps: layup and curing. Layup is the increase because of their unique weight and painstaking process in which multiple layers strength qualities. Depending on the orientation of graphite and fiberglass composite material of the graphite fibers, a part can be are fitted by hand on the exterior of a contoured extremely flexible in one direction but rigid mold. In addition, a part made from takes from two to seven days, depending on composite material is both lighter and the size of the mold and the skill of the technician. The increased use of In the second step, curing, the molded graphite parts, as well as the high cost of a composite material is hardened by pressurized spoiled part (as much as $50,000 for a single heating in a large convection autoclave.

Interactive simulation environments constitute one of today's promising emerging technologies, with applications in areas such as education, manufacturing, entertainment, and training. These environments are also rich domains for building and investigating intelligent automated agents, with requirements for the integration of a variety of agent capabilities but without the costs and demands of low-level perceptual processing or robotic control. Our project is aimed at developing humanlike, intelligent agents that can interact with each other, as well as with humans, in such virtual environments. Our current target is intelligent automated pilots for battlefield-simulation environments. These dynamic, interactive, multiagent environments pose interesting challenges for research on specialized agent capabilities as well as on the integration of these capabilities in the development of "complete" pilot agents. We are addressing these challenges through development of a pilot agent, called TacAir-Soar, within the Soar architecture. This article provides an overview of this domain and project by analyzing the challenges that automated pilots face in battlefield simulations, describing how TacAir-Soar is successfully able to address many of them -- TacAir-Soar pilots have already successfully participated in constrained air-combat simulations against expert human pilots -- and discussing the issues involved in resolving the remaining research challenges.

Countrywide loan-underwriting expert system (clues) is an advanced, automated mortgage-underwriting rule-based expert system. The system was developed to increase the production capacity and productivity of Countrywide branches, improve the consistency of underwriting, and reduce the cost of originating a loan. The system receives selected information from the loan application, credit report, and appraisal. It then decides whether the loan should be approved or whether it requires further review by a human underwriter. If the system approves the loan, no further review is required, and the application is funded. clues has been in operation since February 1993 and is currently processing more than 8500 loans each month in over 300 decentralized branches around the country.