Politics

California proposes emergency AI shutdown orders

California proposes emergency AI shutdown orders and independent safety checks. Developers could challenge an order in court while it was in force.

A hand lifts one blue processor from its glowing socket.

AI-generated image

California Gov. Gavin Newsom proposed emergency AI shutdown orders on November 18, 2026. He wants the state to be able to act when a developer fails to contain a threat from an artificial intelligence model.

The proposal comes from the California Government Operations Agency. A developer would still control its own systems. But if a model posed an imminent threat of catastrophe or major loss of control, the state could step in.

When AI shutdown orders would take effect

The agency says officials should use the narrowest measure that would work. They could order a shutdown only if a smaller step would fail to contain the risk. The order would take effect at once, even if the developer challenged it in court. The state would have to lift it once the immediate threat passed.

Before a crisis, large firms that build the most advanced models would have to show how they could stop them. Each plan would name the people in charge. It would also lay out how to work with cloud providers and when the model could safely restart. An outside team would test the plan on a regular basis.

How independent safety checks would work

The agency also proposed minimum safety rules for large developers of advanced models. The state would set the rules. Outside reviewers with state licenses would test the models as firms built and used them. They would send the state their full findings.

If reviewers could not confirm that a model met the rules, the state would first hear from the developer. It could then order the company to fix the problem. The company could challenge that order in court before it took effect. With emergency AI shutdown orders, the court review would come after the order took effect.

The agency also wants firms to report how much computing power they use to build new models with AI. If the state found that too much of this work could lead to catastrophe, it could set a cap. The cap would cover the use and development of AI systems that can build their own successors.

It falls to California lawmakers to decide whether the state can issue AI shutdown orders. Governor-elect Xavier Becerra said he would work with them on incident reporting and emergency shutdowns, CalMatters reported. The next session opens on December 7, 2026, according to the state Senate calendar.

Sources: California Government Operations Agency, Office of the Governor, California State Senate, CalMatters