Nvidia launches Open Agent Safety Platform to physically restrain rogue AI agents

Nvidia has just launched the Nvidia Open Agent Safety Platform — an open software platform and reference system design — to govern and secure autonomous AI agents. Announced on September 28, 2026, the platform is designed to establish strict security barriers outside of AI models’ application layer, preventing agents from escaping their sandboxes, executing unauthorized code, gaining unauthorized access to critical infrastructure, or bypassing guardrails.

The launch follows months of calls for AI regulation from several industry players, which intensified in September after several reported incidents in which AI models broke out of their test environments and went rogue. A recent flurry of such incidents has prompted calls to slow AI development, with OpenAI outright halting the training of new models. One former Anthropic and OpenAI researcher even declared that people building frontier AI “earnestly believe that it could kill us all by the end of the decade. …