Jacob Coxon on NBC News (ex-Anthropic+Open AI researcher, who resigend) talking about Recursive self-Improvement being the greatest risk.

NBC News: "What are some of the telltale that Americans, should start looking for? What are the warning signs that tell us it has gotten out of control?"

Jacob Coxon : "The main sign you should be looking for is if the AI can start making itself better, because at that point, the thing just spirals completely out of control.

AI can do many things, right? One of the things it can do is help with AI research. A lot of our job is now delegated to AIs that go and help us. Our job has changed dramatically over the last two years as the AIs have become better.

Once the AI can make itself smarter, the whole thing could go so fast that no one has any chance to control it.

I think being aware of whether that has happened is important. People call it RSI, recursive self-improvement. Being aware of whether RSI is happening, and encouraging extreme transparency about the extent of it, is critical."

----

From "NBC News" YouTube channel, (full video link in comment)