The Problem of AI Consciousness

Some things in life cannot be offset by a mere net gain in intelligence. The last few years have seen the widespread recognition that sophisticated AI is under development. Bill Gates, Stephen Hawking, and others warn of the rise of "superintelligent" machines: AIs that outthink the smartest humans in every domain, including common sense reasoning and social skills. Superintelligence could destroy us, they caution. In contrast, Ray Kurzweil, Google's chief engineer, depicts a technological utopia bringing about the end of disease, poverty and resource scarcity.