Bengio on recursive-self improvement: "it should be illegal."
He thinks there is a *1 in 5* chance everyone is about to die.
"Would we allow someone to do an experiment that could destroy the atmosphere, even if we aren't sure if it will work? No!"
(He's the #1 most cited scientist in the world - across *all* fields.
He quit working on AI capabilities to focus on AI safety and warning the world about AI extinction risk.)
"Godfather of AI" Professor Yoshua Bengio says recursive self-improvement — when AI will be able to create new models without human input — should be illegal. "...