ChatGPT answered bioweapon queries as MIT warns of AI catastrophe risks

ChatGPT answered queries of hundreds of people about biological weapons. No federal law required OpenAI to report it to the authorities.

The intention behind the queries remains unclear. It started happening after OpenAI upgraded ChatGPT last year, according to WSJ.

Other companies face the same problem. Users have directed similar questions at Anthropic’s Claude, Google’s Gemini, and Elon Musk’s Grok. It is not yet clear whether those exchanges were genuine attempts to build weapons or tests of the systems’ limits.

User prompts were detailed with questions about producing and releasing poisons and biological agents. The chatbot answered with step-by-step instructions that can easily be executed by a high school biology student.

Experts in biological weapons and terrorism reviewed those conversations. They say some of the answers were highly on point and “deadly accurate”.

ChatGPT bioweapon prompts expose AI reporting gap

Some asked how to turn infectious disease agents into breathable particles, aerosolization.

… Continue reading the full article at the original source below.