The long-term future of space exploration at the National Aeronautics and Space Administration (NASA) is dependent on the full exploitation of autonomous and adaptive systems, but mission managers are worried about the reliability of these more intelligent systems. The main focus of the workshop was to address these worries; hence, we invited NASA engineers working on autonomous and adaptive systems and researchers interested in the verification and validation of software systems. The dual purpose of the meeting was to (1) make NASA engineers aware of the verification and validation techniques they could be using and (2) make the verification and validation community aware of the complexity of the systems NASA is developing. The workshop was held 5 to 7 December 2000 at the Asilomar Conference Center in Pacific Grove, California.

This article gives an overview of two recent events on the validation and verification of knowledge-based systems: (1) the 1997 European Symposium on the Verification and Validation of Knowledge-Based Systems (EUROVAV-97) and (2) the Four-teenth National Conference on Artificial Intelligence Workshop on the Verification and Validation of Knowledge- Based Systems. To give an integrated view of current research issues in this field, we organized this article along thematic lines, unifying the reports of the two separate meetings. Our report focuses on the trends that we think will be important in the near future in this field.

The Workshop on the Validation and Verification of Knowledge-Based Systems gathers researchers from government, industry, and academia to present the most recent information about this important development aspect of knowledge-based systems (KBSs). The 1995 workshop focused on nontraditional KBSs that are developed using more than just the simple rule-based paradigm. This new focus showed how researchers are adjusting to the shift in KBS technology from stand-alone rule-based expert systems to embedded systems that use object-oriented technology, uncertainty, and nonmonotonic reasoning.

The annual Workshop on the Validation and Verification of Knowledge-Based Systems is the leading forum for presenting research on the validation and verification of knowledge-based systems (KBSs). The 1994 workshop was significant in that there was a definitive move in the philosophical position of the workshop from a testing- and tool-based approach to KBS evaluation to that of a formal specification-based approach. This workshop included 12 full papers and 5 short papers and was attended by 35 researchers from government, industry, and academia.

The development of an online turbine generator diagnostic system is described from conception to initial field verification. The system is composed of a data center located in the power plant that collects data from online measurement devices and communicates these data to a centralized diagnostic facility in Orlando, Florida, where the actual diagnosis is done. The resulting diagnosis and recommended actions are transmitted to the power plant where they are displayed to the operator by the data center. The market-place need, initial approaches to the product, system field verification are described.