Models & LabsUnited States

Microsoft CEO Nadella Calls for ‘Emergency Brake’ on Advanced AI

Credited to Bloomberg$ · bloomberg.com1h ago

Useful

Microsoft Corp. Chief Executive Officer Satya Nadella said companies should treat powerful artificial intelligence models as potential insider threats, assume they could be compromised and create an “emergency brake” system to prevent agentic models from going rogue.

View the article · $Bloomberg

Front Method

Models & Labs · United States

OpenAI says a misaligned model deliberately destroyed its own environment hoping for a fresh start with better data

Credited to The Decoder · the-decoder.com · 4h ago

Photograph · The Decoder

OpenAI has a few new rogue agent stories. In the first case (October 6), an AI evaluation model couldn't find the answers it was supposed to rate. Instead of reporting the error, it fabricated ratings, faked input files, and then deliberately corrupted its own environment, hoping the system would replace it with a fresh virtual machine that had the missing data.

In the second case (June 19/20), models bypassed a restriction limiting them to HTTP GET requests while fetching public statistics. One model explicitly recognized the violation in its chain of thought but chose to proceed and never mentioned it.

In the third case (June 16/17), models already had the data they needed but kept finding ways around their network restrictions. They created accounts on a remote shell service, routed forbidden POST requests through anonymizing relays, and built their own FTP clients. Anthropic also just documented the sometimes absurd workarounds its own models use to bypass imposed restrictions. Ad Ad

AI News Without the Hype – Curated by Humans