Goto

Collaborating Authors

 elite silo


The biggest A.I. risks: Superintelligence and the elite silos

#artificialintelligence

BEN GOERTZEL: We can have no guarantee that a super intelligent AI is going to do what we want. Once we're creating something ten, a hundred, a thousand, a million times more intelligent than we are it would be insane to think that we could really like rigorously control what it does. It may discover aspects of the universe that we don't even imagine at this point. However, my best intuition and educated guess is that much like raising a human child, if we raise the young AGI in a way that's imbued with compassion, love and understanding and if we raise the young AGI to fully understand human values and human culture then we're maximizing the odds that as this AGI gets beyond our rigorous control at least it's own self-modification and evolution is imbued with human values and culture and with compassion and connection. So I would rather have an AGI that understood human values and culture become super intelligent than one that doesn't understand even what we're about.