Lenat, Doug
Getting from Generative AI to Trustworthy AI: What LLMs might learn from Cyc
Lenat, Doug, Marcus, Gary
Generative AI, the most popular current approach to AI, consists of large language models (LLMs) that are trained to produce outputs that are plausible, but not necessarily correct. Although their abilities are often uncanny, they are lacking in aspects of reasoning, leading LLMs to be less than completely trustworthy. Furthermore, their results tend to be both unpredictable and uninterpretable. We lay out 16 desiderata for future AI, and discuss an alternative approach to AI which could theoretically address many of the limitations associated with current approaches: AI educated with curated pieces of explicit knowledge and rules of thumb, enabling an inference engine to automatically deduce the logical entailments of all that knowledge. Even long arguments produced this way can be both trustworthy and interpretable, since the full step-by-step line of reasoning is always available, and for each step the provenance of the knowledge used can be documented and audited. There is however a catch: if the logical language is expressive enough to fully represent the meaning of anything we can say in English, then the inference engine runs much too slowly. That's why symbolic AI systems typically settle for some fast but much less expressive logic, such as knowledge graphs. We describe how one AI system, Cyc, has developed ways to overcome that tradeoff and is able to reason in higher order logic in real time. We suggest that any trustworthy general AI will need to hybridize the approaches, the LLM approach and more formal approach, and lay out a path to realizing that dream.
Reports of the AAAI 2010 Fall Symposia
Azevedo, Roger (McGill University) | Biswas, Gautam (Vanderbilt University) | Bohus, Dan (Microsoft Research) | Carmichael, Ted (University of North Carolina at Charlotte) | Finlayson, Mark (Massachusetts Institute of Technology) | Hadzikadic, Mirsad (University of North Carolina at Charlotte) | Havasi, Catherine (Massachusetts Institute of Technology) | Horvitz, Eric (Microsoft Research) | Kanda, Takayuki (ATR Intelligent Robotics and Communications Laboratories) | Koyejo, Oluwasanmi (University of Texas at Austin) | Lawless, William (Paine College) | Lenat, Doug (Cycorp) | Meneguzzi, Felipe (Carnegie Mellon University) | Mutlu, Bilge (University of Wisconsin, Madison) | Oh, Jean (Carnegie Mellon University) | Pirrone, Roberto (University of Palermo) | Raux, Antoine (Honda Research Institute USA) | Sofge, Donald (Naval Research Laboratory) | Sukthankar, Gita (University of Central Florida) | Durme, Benjamin Van (Johns Hopkins University)
The Association for the Advancement of Artificial Intelligence was pleased to present the 2010 Fall Symposium Series, held Thursday through Saturday, November 11-13, at the Westin Arlington Gateway in Arlington, Virginia. The titles of the eight symposia are as follows: (1) Cognitive and Metacognitive Educational Systems; (2) Commonsense Knowledge; (3) Complex Adaptive Systems: Resilience, Robustness, and Evolvability; (4) Computational Models of Narrative; (5) Dialog with Robots; (6) Manifold Learning and Its Applications; (7) Proactive Assistant Agents; and (8) Quantum Informatics for Cognitive, Social, and Semantic Processes. The highlights of each symposium are presented in this report.
Reports of the AAAI 2010 Fall Symposia
Azevedo, Roger (McGill University) | Biswas, Gautam (Vanderbilt University) | Bohus, Dan (Microsoft Research) | Carmichael, Ted (University of North Carolina at Charlotte) | Finlayson, Mark (Massachusetts Institute of Technology) | Hadzikadic, Mirsad (University of North Carolina at Charlotte) | Havasi, Catherine (Massachusetts Institute of Technology) | Horvitz, Eric (Microsoft Research) | Kanda, Takayuki (ATR Intelligent Robotics and Communications Laboratories) | Koyejo, Oluwasanmi (University of Texas at Austin) | Lawless, William (Paine College) | Lenat, Doug (Cycorp) | Meneguzzi, Felipe (Carnegie Mellon University) | Mutlu, Bilge (University of Wisconsin, Madison) | Oh, Jean (Carnegie Mellon University) | Pirrone, Roberto (University of Palermo) | Raux, Antoine (Honda Research Institute USA) | Sofge, Donald (Naval Research Laboratory) | Sukthankar, Gita (University of Central Florida) | Durme, Benjamin Van (Johns Hopkins University)
The Association for the Advancement of Artificial Intelligence was pleased to present the 2010 Fall Symposium Series, held Thursday through Saturday, November 11-13, at the Westin Arlington Gateway in Arlington, Virginia. The titles of the eight symposia are as follows: (1) Cognitive and Metacognitive Educational Systems; (2) Commonsense Knowledge; (3) Complex Adaptive Systems: Resilience, Robustness, and Evolvability; (4) Computational Models of Narrative; (5) Dialog with Robots; (6) Manifold Learning and Its Applications; (7) Proactive Assistant Agents ; and (8) Quantum Informatics for Cognitive, Social, and Semantic Processes. The highlights of each symposium are presented in this report.
Preface
Havasi, Catherine (Massachusetts Institute of Technology) | Lenat, Doug (Cycorp) | Durme, Benjamin Van (Johns Hopkins University)
When we are confronted with unexpected situations, we deal of background knowledge and special-purpose reasoners to with them by falling back on our general knowledge or making support general inference. Recent advances in text mining, analogies to other things we know. When software applications crowdsourcing, and professional knowledge engineering efforts fail, on the other hand, they often do so in brittle have finally led to commonsense knowledge bases of and unfriendly ways. At the same time, new application colleagues grappling with representation and reasoning, to domains are giving fresh insights into desiderata for common Doug Lenat, Push Singh, and Lenhart Schubert conducting sense reasoners and guidance for knowledge collection large scale engineering projects to construct collections efforts.