Claims and Challenges in Evaluating Human-Level Intelligent Systems

The paper on which this AGI-09 (2nd conference on Artificial General Intelligence) presentation by John Laird is based represents a first step in attempting to engage the research community in discussions about evaluation of human-level intelligent systems. First, we discuss the challenges of evaluating human-level intelligent systems. Second, we explore the different types of claims that are made about HLI systems, which are the basis for confirmatory evaluations. Finally, we briefly discuss a range of experimental designs that support the evaluation of claims.

Vertical Tabs