A reported AI stop proposal sets its trigger at catastrophe scale
How much harm must be foreseeable before a government can stop the release of a frontier AI model? Reuters, citing Politico's reporting on a draft Anthropic circulated to lawmakers, says the proposed trigger would be imminent foreseeable damage above $1 billion or more than 50 people killed or seriously injured, tied to specified biological, cyber or model-control scenarios. That is a description of a reported private proposal, not an enacted bill or language we independently verified from a published draft. Under the reported design, registered independent evaluators would flag enumerated imminent risks to Commerce within 72 hours, and the department would seek a federal judge's order before blocking a model. It reportedly would not grant other agencies that suspension power. Anthropic says the proposal aligns with its previously published advanced AI framework. There is a real appeal to a narrow trigger. It could make an emergency power less prone to arbitrary use or a political fight over ordinary product defects. But what institution handles harms that are serious, repeated and dispersed, yet never look like one billion-dollar catastrophe or a fifty-person event? Privacy loss, discrimination and low-level cyber abuse might fall outside this particular emergency mechanism and still warrant other law. The next step is to publish the actual language, test its definitions against concrete cases and see whether lawmakers introduce anything like it. A private pitch is the beginning of a legislative argument, not its end.
