Anthropic, the company behind the Claude AI model, is publicly asking its competitors to consider slowing down. In a blog post Thursday, the company argued that AI systems may soon be capable of improving themselves without human involvement, a scenario it says carries significant societal risks.
The core message: the ability to slow global AI development would likely be a good thing.
The self-improvement problem
Anthropic is flagging something subtle but consequential: recursive self-improvement. That means AI models that can make themselves smarter without human engineers steering the process. Once that loop starts, the pace of change could outstrip any lab’s ability to test for safety, let alone any government’s ability to regulate it.
Anthropic disclosed internal data showing how quickly its most advanced models are improving, though it did not make specific benchmarks public. The implication: Anthropic is watching its own creations get better at a rate that gives even Anthropic pause.
A lab telling itself to slow down
This is an unusual move. AI companies typically compete on capability. For one of the leading labs to publicly suggest the industry collectively ease off the gas pedal is roughly equivalent to a Formula 1 team asking organizers to lower the speed limit.
Anthropic has positioned itself as the safety-first lab since its founding by former OpenAI researchers. But calling for a slowdown across all top labs globally represents a meaningful escalation of that stance.
The challenge is coordination. Even if every US-based lab agreed to slow down tomorrow, labs in China, the UAE, and elsewhere face different incentives. A voluntary pause only works if everyone participates.
What this means for investors
If self-improvement capabilities emerge sooner than expected, the regulatory response could be swift and blunt: restrictions on compute access, model deployment, or training runs. That would directly affect the revenue trajectories of companies building on frontier AI.
Safety-focused positioning may become a competitive advantage if regulation tightens. Companies that can demonstrate responsible development could find themselves with preferred access to government contracts, while labs perceived as reckless face scrutiny. Anthropic is betting its reputation on being in the first camp.