Anthropic loses another researcher, and he’s predicting human doom from AI

Anthropic has lost another safety researcher. Joe Tenton said he left the company two weeks ago and will join METR, an independent group that tests risks in advanced AI systems.

Joe had planned to explain the move later, but Jacob’s resignation this week changed that. He said:

“I’d planned to write about that decision in more detail at some point, but Jacob’s resignation this week made me want to say more now.”

Joe believes major AI labs are creating a level of danger society has never faced, saying that AI capability is improving at extreme speed while companies are trying to move even faster.

Their goal is to build systems that can improve AI research themselves and eventually reach “superintelligence.” Joe warned that success could make progress move beyond human control.

Joe says AI labs are racing toward systems humans may not be able to contain

Joe said people could be living with AI agents smarter than every human within the next few years. Those systems may also develop goals that do not match the people supervising them. If their abilities become too strong to restrict, he believes the result could be disastrous. “Humanity may not survive this transition,” he wrote.

… Continue reading the full article at the original source below.