Why Oxford's John Lennox Wrote a Book on AI Promises and Threats

But the second kind of artificial intelligence, AGI, artificial general intelligence, is really the quest for a superintelligence of one of two kinds, either enhancing human beings as they exist and building a biological superintelligence, or else discovering ways of uploading or downloading the contents, say, of the human mind onto silicone, so that we remove the dependence on an organic substrate. And there, it seems to me, that the likelihood of building a superintelligence that exceeds human capacity in every direction is very slim, because human intelligence is conscious. And we don't know what consciousness is. No scientist knows what consciousness is. And that the most serious people recognize that, that is a huge barrier.