This post, too, leaves me more puzzled than enlightened. The concerns about the potential havoc AI might wreak are so heavily laden with hypotheticals that I seriously wonder how senior developers at Anthropic could succumb to this modern form of AI psychosis.
To reiterate: so far, all I’m reading is that AI 1) can be misused, 2) sometimes behaves in ways that defy expectations, and 3) is the subject of a global race between nations.
All of that is certainly true. Yet, I fail to see how this translates into a danger so significant and tangible that these people would quit their jobs. On the contrary: humanity has always found ways to ensure its survival when facing existential threats (take nuclear weapons, for instance). The only difference here is that AI is an entity alleged to be - at least in part - uncontrollable. However, I still see no scientific basis for the conclusion (or argument) that this could lead to humanity’s extinction.
Again: if anyone has solid reasons or papers on this, please send them my way. Otherwise, it remains a mystery to me.