The Trouble with the Turing Test

In the October 1950 issue of the British quarterly Mind, Alan Turing published a 28-page paper titled "Computing Machinery and Intelligence." It was recognized almost instantly as a landmark. In 1956, less than six years after its publication in a small periodical read almost exclusively by academic philosophers, it was reprinted in The World of Mathematics, an anthology of writings on the classic problems and themes of mathematics and logic, most of them written by the greatest mathematicians and logicians of all time. It has influenced a wide range of intellectual disciplines -- artificial intelligence (AI), robotics, epistemology, philosophy of mind -- and helped shape public understanding, such as it is, of the limits and possibilities of non-human, man-made, artificial "intelligence." Turing's paper claimed that suitably programmed digital computers would be generally accepted as thinking by around the year 2000, achieving that status by successfully responding to human questions in a human-like way. In preparing his readers to accept this idea, he explained what a digital computer is, presenting it as a special case of the "discrete state machine"; he offered a capsule explanation of what "programming" such a machine means; and he refuted -- at least to his own satisfaction -- nine arguments against his thesis that such a machine could be said to think. But these sections of his paper are not what has made it so historically significant. The part that has seized our imagination, to the point where thousands who have never seen the paper nevertheless clearly remember it, is Turing's proposed test for determining whether a computer is thinking -- an experiment he calls the Imitation Game, but which is now known as the Turing Test. The Test calls for an interrogator to question a hidden entity, which is either a computer or another human being. The questioner must then decide, based solely on the hidden entity's answers, whether he had been interrogating a man or a machine. If the interrogator cannot distinguish computers from humans any better than he can distinguish, say, men from women by the same means of interrogation, then we have no good reason to deny that the computer that deceived him was thinking. And the only way a computer could imitate a human being that successfully, Turing implies, would be to actually think like a human being. Turing's thought experiment was simple and powerful, but problematic from the start. Turing does not argue for the premise that the ability to convince an unspecified number of observers, of unspecified qualifications, for some unspecified length of time, and on an unspecified number of occasions, would justify the conclusion that the computer was thinking -- he simply asserts it.