Bayesian Inference
Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project
Buchanan, Bruce G., Shortliffe, Edward H.
Artificial intelligence, or AI, is largely an experimental science—at least as much progress has been made by building and analyzing programs as by examining theoretical questions. MYCIN is one of several well-known programs that embody some intelligence and provide data on the extent to which intelligent behavior can be programmed. As with other AI programs, its development was slow and not always in a forward direction. But we feel we learned some useful lessons in the course of nearly a decade of work on MYCIN and related programs. In this book we share the results of many experiments performed in that time, and we try to paint a coherent picture of the work. The book is intended to be a critical analysis of several pieces of related research, performed by a large number of scientists. We believe that the whole field of AI will benefit from such attempts to take a detailed retrospective look at experiments, for in this way the scientific foundations of the field will gradually be defined. It is for all these reasons that we have prepared this analysis of the MYCIN experiments.
The complete book in a single file.
Methodological Simplicity in Expert System Construction: The Case of Judgments and Reasoned Assumptions
Editors' Note: Many expert systems require some means criticisms of this approach from those steeped in the practical of handling heuristic rules whose conclusions are less than certain issues of constructing large rule-based expert systems. Abstract the expert system draws inferences in solving different problems. Doyle's paper argues that it is difficult for a human expert "certainty factors," and in spite of the experimentally observed insensitivity of system performance to perturbations of the chosen values Recent successes of "expert systems" stem from much Research Projects Agency (DOD), ARPA Order No. 3597, monitored In the following, we explain the modified approach together with its practical and theoretical attractions. The client's income bracket is 50%, can be found (Minsky, 1975; Shortliffe & Buchanan, 1975; and 2. The client carefully studies market trends, Duda, Hart, & Nilsson, 1976; Szolovits, 1978; Szolovits & THEN: 3. There is evidence (0.8) that the investment Pauker, 1978). Reasoned Assumptions (from Davis, 1979) and would use the rule to draw conclusions whose "certainty factors" depend on the observed certainty Although our approach usually approximates that of Bayesian probabilities, accommodates representational systems based on "frames" namely as subjective degrees of belief.
Reverend Bayes on Inference Engines: A Distributed Hierarchical Approach
This paper presents generalizations of Bayes likelihood-ratio updating rule which facilitate an asynchronous propagation of the impacts of new beliefs and/or new evidence in hierarchically organized inference structures with multi-hypotheses variables. The computational scheme proposed specifies a set of belief parameters, communication messages and updating rules which guarantee that the diffusion of updated beliefs is accomplished in a single pass and complies with the tenets of Bayes calculus.Proc AAAI
Maximum likelihood from incomplete data via the EM algorithm
Dempster, A. P., Laird, N., Rubin, D.
Wiley is a global provider of content and content-enabled workflow solutions in areas of scientific, technical, medical, and scholarly research; professional development; and education. Our core businesses produce scientific, technical, medical, and scholarly journals, reference works, books, database services, and advertising; professional books, subscription products, certification and training services and online applications; and education content and services including integrated online teaching and learning resources for undergraduate and graduate students and lifelong learners. Founded in 1807, John Wiley & Sons, Inc. has been a valued source of information and understanding for more than 200 years, helping people around the world meet their needs and fulfill their aspirations. Wiley has published the works of more than 450 Nobel laureates in all categories: Literature, Economics, Physiology or Medicine, Physics, Chemistry, and Peace. Wiley has partnerships with many of the world's leading societies and publishes over 1,500 peer-reviewed journals and 1,500 new books annually in print and online, as well as databases, major reference works and laboratory protocols in STMS subjects.
Case grammar
Lexical ambiguity can be syntactic if it involves more than one grammatical category for a single word, or semantic if more than one meaning can be associated with a word. In this article we discuss the application of a Bayesian-network model in the resolution of lexical ambiguities of both types. The network we propose comprises a parsing subnetwork, which can be constructed automatically for any context-free grammar, and a subnetwork for semantic analysis, which, in the spirit of Fillmore's (1968) case grammars, seeks to fulfill the required cases of all candidates for verb of the sentence. Solving for the highest joint probability of the variables conditioned upon the evidences to the network yields the most likely candidate with its meaning, along with its cases and respective meanings. This is achieved by fixing the values of all evidence nodes concurrently, and then performing a stochastic simulation in which the remaining nodes are updated probabilistically with a high degree of parallelism.