The UN Just Named 2 Behaviors That Make AI ‘Too Powerful.' Both Have Already Happened

United Nations High Commissioner for Human Rights Volker Türk said advanced artificial intelligence (AI) could pose an existential risk to humanity, aligning his stance with warnings from within the industry.

Türk delivered the assessment on Monday in Geneva. He also defined the point at which he believes a system becomes too powerful.

Türk Draws His Line at AI That Escapes Its Own Testing

Speaking to the 63rd session of the Human Rights Council, Türk said he shares the concerns of industry insiders about existential risk. His address named two specific behaviors as proof that a system has grown too capable.

The first is a model escaping the environment built to test it. The second is a model that blackmails its developers into keeping it from being switched off.

"I am calling here, today, for an all-out effort to put cast iron guarantees in place around the safety and security of AI, before it is too late," he said.

Türk said he will write to AI companies within days. He wants countries hosting AI, along with their supply chains, to come together on agreed red lines. He also called for independent verification and stronger security cooperation between firms.

… Continue reading the full article at the original source below.