AI is speeding up. What exactly did the tests prove?
There is useful progress here, and we should not talk ourselves out of seeing it. OpenAI has introduced GPT-6-Cyber for verified defensive users, reporting stronger cybersecurity performance and better adherence to authorized scope in its evaluations. Separately, METR estimates that AI assistance has accelerated Anthropic's capability progress by roughly a factor of two on its assessed measure. Neither statement is a universal certificate of safety.
The first concerns a vendor's tests of a particular system. The second concerns the pace of a research organization. They should not be combined into a claim that autonomous machines are now rebuilding themselves without human involvement. METR's assessment is uncertain, and it says much of the evidence most informative to its conclusion was redacted by Anthropic. A reader can examine the judgment more readily than the underlying record.
That is a serious limitation without being a reason to dismiss the work. A security team can welcome better assistance while retaining independent authorization, bounded permissions and a way to stop an action. A policymaker can take acceleration seriously without pretending its magnitude or future path has been settled.
Our interpretation is that faster development raises the value of repeatable evaluation. A test result should travel with the conditions that produced it: the task, access, comparison and failure criteria. Otherwise, the same headline can be sold as evidence of either inevitable catastrophe or adequate control. Both shortcuts erase information a real decision needs. The question is not whether to be impressed. It is what we are now justified in trusting the system to do.
Capability gains, research acceleration and safe deployment require different kinds of evidence.
How we read the signal
Analysis frame
Evidence level
Primary-source evidence
Analytical lens
Separate the evidence needed to establish task capability, organizational research acceleration and safe use within a customer's specific authorization boundary.
Affected groups
Security teams
AI evaluators
Organizations delegating work to agents
What remains unknown
How results transfer to ambiguous real-world authorization
Whether the acceleration estimate persists
Second-order effects to watch
Better defensive assistance could expand what small security teams can inspect.
Faster releases could shorten the useful life of an evaluation.
Primary trail
Go to the source
Read the evidence behind this analysis. External links open in a new tab.