Anthropic says it made model-copying harder. The trade-offs are only beginning.
An AI company's best model can become the training data for a rival. Anthropic calls unauthorized large-scale extraction of its model's outputs 'distillation' and says it has deployed new defenses against that practice. In its own tests, the company reports a 10- to 100-fold reduction in extractable reasoning tokens for attack methods it studied, with false positives below 0.1%. Those are vendor-reported figures, not an independent audit, and Anthropic acknowledges that more sophisticated methods may behave differently. It also says it has banned tens of thousands of accounts and that blocked requests may now be charged. The policy raises a genuine trade-off. Protecting a model can also protect safety controls and commercial incentives; heavy-handed barriers can inconvenience legitimate researchers, developers and users, and shape who is allowed to learn from a powerful system. Distillation is not inherently illicit in every context—model training on outputs can be authorized. The issue here is access at scale without permission and the opacity of the resulting enforcement. The crucial questions are how false positives are handled in real use, how appeals work, and whether independent evaluators can still probe safety claims. A single benchmark cannot tell us whether the defenses will remain effective or whether they will become a new gate around the AI ecosystem. The next evidence should be repeated independent tests and transparent appeal outcomes, not just a claimed multiple of blocked tokens.
