Top AI labs reportedly planning for catastrophic AI event fallout

Anthropic, OpenAI, and other AI labs are reportedly gaming out scenarios where a rogue AI wreaks havoc on critical infrastructure, like financial services, internet and telecommunications, or utilities such as power and water. According to Axios, the leadership of these companies is privately preparing for such an incident, similar to how the Pentagon has been running war games to see the results of different strategies in case of a nuclear exchange between nations.

Planning like this is not unheard of in the corporate world, with enterprises sometimes running business continuity exercises to account for contingencies. However, what’s concerning is that these exercises are in preparation for a major AI incident, something that many industry experts believe would happen within the next six to 12 months. "OpenAI conducts preparedness exercises where teams discuss and work through a range of potential scenarios," a company spokesperson told the publication. …