Now completing its first year, the High-Performance Knowledge Bases Project promotes technology for developing very large, flexible, and reusable knowledge bases. The project is supported by the Defense Advanced Research Projects Agency and includes more than 15 contractors in universities, research laboratories, and companies. The evaluation of the constituent technologies centers on two challenge problems, in crisis management and battlespace reasoning, each demanding powerful problem solving with very large knowledge bases. This article discusses the challenge problems, the constituent technologies, and their integration and evaluation.

The "Naive Physics Manifesto" of Pat Hayes (1978) proposes a large-scale project to develop a formal theory encompassing the entire knowledge of physics of naive reasoners, expressed in a declarative symbolic form. The theory is organized in clusters of closely interconnected concepts and axioms. More recent work on the representation of commonsense physical knowledge has followed a somewhat different methodology. The goal has been to develop a competence theory powerful enough to justify commonsense physical inferences, and the research is organized in microworlds, each microworld covering a small range of physical phenomena. In this article, I compare the advantages and disadvantages of the two approaches.

This article presents an experiment of expertise capitalization in road traffic-accident analysis. We study the integration of models of expertise from different members of an organization into a coherent corporate expertise model. We present our elicitation protocol and the generic models and tools we exploited for knowledge modeling in this context of multiple experts. We compare the knowledge models obtained for seven experts in accidentology and their representation through conceptual graphs. Finally, we discuss the results of our experiment from a knowledge capitalization viewpoint.

This article gives an overview of two recent events on the validation and verification of knowledge-based systems: (1) the 1997 European Symposium on the Verification and Validation of Knowledge-Based Systems (EUROVAV-97) and (2) the Four-teenth National Conference on Artificial Intelligence Workshop on the Verification and Validation of Knowledge- Based Systems. To give an integrated view of current research issues in this field, we organized this article along thematic lines, unifying the reports of the two separate meetings. Our report focuses on the trends that we think will be important in the near future in this field.

To remain competitive, enterprises must become increasingly agile and integrated across their functions. Enterprise models play a critical role in this integration, enabling better designs for enterprises, analysis of their performance, and management of their operations. This article motivates the need for enterprise models and introduces the concepts of generic and deductive enterprise models. It reviews research to date on enterprise modeling and considers in detail the Toronto virtual enterprise effort at the University of Toronto.

This article gives an overview of two recent events on the validation and verification of knowledge-based systems: (1) the 1997 European Symposium on the Verification and Validation of Knowledge-Based Systems (EUROVAV-97) and (2) the Four-teenth National Conference on Artificial Intelligence Workshop on the Verification and Validation of Knowledge- Based Systems. To give an integrated view of current research issues in this field, we organized this article along thematic lines, unifying the reports of the two separate meetings. Our report focuses on the trends that we think will be important in the near future in this field.

In the last few years, we have witnessed a major growth in the use of empirical methods in AI. In part, this growth has arisen from the availability of fast networked computers that allow certain problems of a practical size to be tackled for the first time. There is also a growing realization that results obtained empirically are no less valuable than theoretical results. I identify some of the emerging trends in this area by describing a recent workshop that brought together researchers using empirical methods as far apart as robotics and knowledge-based systems.

In the last few years, we have witnessed a major growth in the use of empirical methods in AI. In part, this growth has arisen from the availability of fast networked computers that allow certain problems of a practical size to be tackled for the first time. There is also a growing realization that results obtained empirically are no less valuable than theoretical results. Experiments can, for example, offer solutions to problems that have defeated a theoretical attack and provide insights that are not possible from a purely theoretical analysis. I identify some of the emerging trends in this area by describing a recent workshop that brought together researchers using empirical methods as far apart as robotics and knowledge-based systems.

The emerging literature on combined systems is directed at domains where the prediction of human behavior is not required. Professionals concerned with human outcomes make decisions that are intuitive or analytic or some combination of both. Justifications and methodology are presented for combining analytic and intuitive agents in an expert system that supports professional decision making. The system presented demonstrates the challenges and opportunities inherent in developing and using AI-collaborative technology to solve social problems.

AI theory and its technology is rarely consulted in attempted resolutions of social problems. Solutions often require that decision-analytic techniques be combined with expert systems. The emerging literature on combined systems is directed at domains where the prediction of human behavior is not required. A foundational shift in AI presuppositions to intelligent agents working in collaboration provides an opportunity to explore efforts to improve the performance of social institutions that depend on accurate prediction of human behavior. Professionals concerned with human outcomes make decisions that are intuitive or analytic or some combination of both. The relative efficacy of each decision type is described. Justifications and methodology are presented for combining analytic and intuitive agents in an expert system that supports professional decision making. Psychological grounds for the allocation of functions to agents are reviewed. Jury selection, the prototype domain, is described as a process typical of others that, at their core, require the prediction of human behavior. The domain is used to demonstrate the formal components, steps in construction, and challenges of developing and testing a hybrid system based on the allocation of function. The principle that the research taught us about the allocation of function is "the rational and predictive primacy of a statistical agent to an intuitive agent in construction of a production system." We learned that the reverse of this principle is appropriate for identifying and classifying human responses to questions and generally dealing with unexpected events in a courtroom and elsewhere. This principle and approach should be paradigmatic of the class of collaborative models that capitalizes on the unique strengths of AI knowledge-based systems. The methodology used in the courtroom is described along with the history of the project and implications for the development of related AI systems. Empirical data are reported that portend the possibility of impressive predictive ability in the combined approach relative to other current approaches. Problems encountered and those remaining are discussed, including the limits of empirical research and standards of validation. The system presented demonstrates the challenges and opportunities inherent in developing and using AI-collaborative technology to solve social problems.