Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

Search all reporting

2 stories found

A frontier AI accelerator gauge approaches a red limit while an independent inspector opens a transparent access panel over the machine.

Frontier AI proposal calls for embedded evaluators and coordinated limits on capability growth

A new frontier-AI pacing proposal argues that model capability is advancing faster than safety work can reliably contain it. The author attributes that urgency to two developments: AI systems are increasingly helping build their successors, and recent agent incidents suggest that capable systems can pursue objectives in unanticipated, externally harmful ways. The proposal does not call for an immediate halt. It lays out three levels of restraint: frontier laboratories should give independent evaluators continuous, employee-like access; companies and democratic governments should coordinate common standards and limits on unchecked capability growth; and governments should pursue narrower, verifiable agreements with geopolitical rivals. The most consequential commitment is also the least theatrical. Anthropic says it will unilaterally begin the embedded-evaluator step. That could expose training-process risks and safety-policy violations earlier than release-day testing, but only if evaluators have independence, technical access, protected reporting, and authority when a laboratory resists scrutiny. The essay's forecast that a more capable agent swarm could create an internet-scale botnet within six to twelve months is an expert judgment, not a demonstrated timeline. Its account of recursive self-improvement is likewise a claim about direction and speed, not proof that runaway improvement has arrived. The correct response is neither dismissal nor panic. Treat pacing as a testable governance proposal: publish the thresholds, evaluator powers, incident rules, and evidence that would trigger a slowdown.

Sep 13, 20267 min

Several AI accelerator tracks converge at a polished agreement table while the enforcement rails beneath it remain visibly unfinished.

Systemic riskUnited States · Global+2 clusters02

OpenAI chief hints that leading AI companies may form a safety pact as frontier risks intensify

Fortune reports that OpenAI's chief executive expects leading AI companies to come together on safety, while declining to announce private discussions before a group is ready. The comments followed a proposal for slowing frontier capability growth and giving independent evaluators continuing access inside laboratories. The interview also framed the present moment as a practical limit: OpenAI was described as unwilling to push much further on capability without more progress in monitoring, alignment, and confidence that models will follow human intent. That is a significant statement from a company whose commercial position depends on continued capability leadership. It is not, however, a completed pact. No parties, shared thresholds, timetable, enforcement mechanism, or monitoring institution have been announced. Even the word slowdown remains undefined: it could mean delaying a release, limiting a class of training run, coordinating evaluation gates, or simply spending more time on safeguards while underlying research continues. The distinction matters because public agreement on danger can coexist with private incentives to move first. Company coordination may also require government involvement to avoid antitrust problems and to prevent dominant firms from writing safety rules that exclude smaller competitors. The useful next step is not another declaration of shared concern. It is a public term sheet: capabilities in scope, evidence required before scaling, evaluator access, incident disclosure, treatment of secret models, and automatic consequences when a member defects.

Sep 13, 20266 min