Genre
How Evaluation Guides AI Research: The Message Still Counts More than the Medium
Cohen, Paul R., Howe, Adele E.
Evaluation should be a mechanism of progress both within and across AI research projects. For the individual, evaluation can tell us how and why our methods and programs work and, so, tell us how our research should proceed. For the community, evaluation expedites the understanding of available methods and, so, their integration into further research. In this article, we present a five-stage model of AI research and describe guidelines for evaluation that are appropriate for each stage. These guidelines, in the form of evaluation criteria and techniques, suggest how to perform evaluation. We conclude with a set of recommendations that suggest how to encourage the evaluation of AI research.
Contributors
He is a and Information Science at The and Information Science at The Distinguished Professor of Computer Ohio State University, Columbus, Ohio State University, Columbus, Science at the University of Minnesota, Ohio 43210. He is currently writing Ohio 43210. He is currently writing a position he has held since 1984.
Uncertainty in Artificial Intelligence
The Fourth Uncertainty in Artificial Intelligence workshop was held 19-21 August 1988. The workshop featured significant developments in application of theories of representation and reasoning under uncertainty. A recurring idea at the workshop was the need to examine uncertainty calculi in the context of choosing representation, inference, and control methodologies. The effectiveness of these choices in AI systems tends to be best considered in terms of specific problem areas. These areas include automated planning, temporal reasoning, computer vision, medical diagnosis, fault detection, text analysis, distributed systems, and behavior of nonlinear systems. Influence diagrams are emerging as a unifying representation, enabling tool development. Interest and results in uncertainty in AI are growing beyond the capacity of a workshop format.
A Novel Approach to Expert Systems for Design of Large Structures
Adeli, H., Balasubramanian, K. V.
A novel approach is presented for the development of expert systems for structural design problems. This approach differs from the conventional expert systems in two fundamental respects. First, mathematical optimization is introduced into the design process. Second, a computer is used to obtain parts of the knowledge necessary in the expert systems in addition to heuristics and experiential knowledge obtained from documented materials and human experts. As an example of this approach, a prototype coupled expert system, the bridge truss expert (BTExpert), is presented for optimum design of bridge trusses subjected to moving loads. BTExpert was developed by interfacing an interactive optimization program developed in Fortran 77 to an expert system shell developed in Pascal. This new generation of expert systems-embracing various advanced technologies such as AI (machine intelligence), the numeric optimization technique, and interactive computer graphics -- should find enormous practical implications.
A Method for Evaluating Candidate Expert System Applications
Slagle, James, Wick, Michael R.
Second, the problem domain of the used be as good as possible. Two The application task requires little task is stable. This means that the characteristics of the domain expert or no common sense. Although domain should be well established can help determine the degree of researchers are continuing to study and unlikely to undergo vast changes expertise. First, the expert is highly the representation of commonsense during the life of the expert system respected by experienced people in the knowledge, no practical systems have project. This stability does not require domain field. Because the goal of the been developed to date (Lenat, that the problem-solving process project is often to simulate the Prakash, and Shepherd 1986). A problem required to perform the task be well expert's performance, this expert requiring common sense on the understood, simply that the basics of should be viewed by others as a genuine part of the expert should be left to a the task domain be established.
Letters to the Editor
Milliken, Keith, Rheinfurth, Klaus, Begg, Vivienne
Is it because they have been "mastered," or have become "trivial?" Indeed, many new problems for these applications add to the complexity of the solutions rater than trivialize them. Indeed, the work of myself and course, is no longer mathematics. The YES/L1 language is an integration of artificial intelligence is at a of procedural and rule-based techniques. Condition-action rules in plateau from which it can rise or fall YES/L1 are driven by a RETElike algorithm.
Prose Generation from Expert Systems: An Applied Computational Linguistics Approach
The PROSENET/TEXTNET approach is designed to facilitate the generation of polished prose by an expert system. The approach uses the augmented transition network (ATN) formalism to help structure prose generation at the phrase, sentence, and paragraph levels. The approach also uses expressive frames to help give the expert system builder considerable freedom to organize material flexibly at the paragraph level. The PROSENET /TEXTNET approach has been used in a number of prototype expert systems in medical domains, and has proved to be a convenient and powerful tool.
A Knowledge-Based Model of Audit Risk
Dhar, Vasant, Lewis, Barry, Peters, James
Within the academic and professional auditing communities, there has been growing concern about how to accurately assess the various risks associated with performing an audit. These risks are difficult to conceptualize in terms of numeric estimates. This article discusses the development of a prototype computational model (computer program) that assesses one of the major audit risks -- inherent risk. This program bases most of its inferencing activities on a qualitative model of a typical business enterprise.