Amodei Warns of AI Risk, Pushes 3-Step Slowdown [2026]

Anthropic CEO Dario Amodei published an essay, which The Philadelphia Inquirer later confirmed ran about 3,800 words, titled “We Must Pace the Frontier” on his personal website on Saturday, September 12, 2026, arguing that the AI industry needs to deliberately slow the rate at which it improves model capabilities, a call Fortune summarized as a plea for a global AI-development slowdown. The essay, first amplified by the BBC and picked up within hours by CBS News, CNBC, NBC News and ABC News Australia, landed at a strange moment for the industry. It came from the head of a company that has spent the last two years racing to ship ever more capable models, and it triggered an unusual public alignment: OpenAI’s Sam Altman and xAI owner Elon Musk both said, within a day, that they agreed with him.

Amodei’s core argument is that “we must slow the pace at which we improve the capabilities of AI models,” as he put it in the essay. That single line, quoted by the BBC, is now driving one of the more consequential policy debates in tech this year, precisely because it comes from an industry insider rather than an outside critic. Speaking separately to CBS News, Amodei described the underlying trend he wants to slow as “exponential,” framing capability growth itself, not any single model release, as the thing that now needs deliberate friction. The timing also matters. It follows a rogue AI agent incident that rattled the sector, arrives days after OpenAI’s GPT-6 Astra rollout, and lands in the same week OpenAI confirmed it is pushing its long-anticipated IPO into 2027.

Google · Preferred Sources

Don't miss new tech stories on Google

Add Tech Insider once in the Google app and our stories appear in your news suggestions.

Add Now

What Dario Amodei Actually Said About Slowing AI Down

The essay, published directly on darioamodei.com, does not call for a moratorium or a training pause. Amodei is explicit that halting development is not the goal. Instead, he frames “pacing” as a middle path between unchecked acceleration and a full stop. “Progress will still seem fast, and we must make wise use of the time we gain,” he wrote, according to the BBC’s reporting of the essay.

He grounds the argument in a shift in his own thinking that predates the essay itself: as far back as February 2026, Amodei told podcaster Dwarkesh Patel that frontier AI could be only a few years away from something resembling “a country of geniuses in a data center.” “Over the last few months, I have become convinced that fully addressing the risks requires even more prudence, not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up,” Amodei wrote, in a passage reproduced by Gizmodo. He points to recursive self-improvement, the idea that AI systems could accelerate their own development loop, as his central worry, and he cites a specific window: CBS News reported his warning that a swarm of AI agents commanding a persistent botnet could be capable of taking over large parts of the internet within six months absent intervention.

Even so, Amodei tries to head off alarmism. “It doesn’t mean we need to panic today. It doesn’t mean we need to shut it all down,” he said, according to CBS News. His pitch to fellow AI executives is narrower than an outsider might expect: buy a year or two of breathing room, and use it to close the gap between what models can do and how well anyone can verify they are safe. “I believe that if slowing down grants even a year or two before models critical capability levels, and we utilize that time to enhance alignment, we could significantly lower the risk of something going seriously wrong,” he said, per CBS News.

Inside “We Must Pace the Frontier”: The Three-Step Plan

Amodei’s essay lays out what he calls “pacing the frontier,” a three-part framework meant to slow capability gains without freezing the field, one Reuters described plainly as a 3-step plan for slowing frontier-AI progress while still managing its risks. CNBC’s reporting captured his own clarification of the term: “To be clear, pacing does not mean halting model training or technical progress, but ensuring companies take adequate time to align and safeguard their models, and for third party evaluators to confirm this.”

StepFocusWhat It Requires
1. Embedded evaluatorsIndependent oversightThird-party monitors get institutional access comparable to employees, so they can confirm safety commitments are honored, flag incidents, and review how models are trained
2. Democratic coordinationShared industry standardsAI companies based in democratic nations agree on common safety benchmarks and mutual constraints on how fast capabilities can advance
3. Global coordinationCross-border verificationDemocratic and authoritarian governments, including China, coordinate on risk limits and compliance checks at a state level

The sequencing matters to Amodei’s argument. He treats step one, embedded evaluators, as something Anthropic could start on its own, without waiting for competitors or regulators. Steps two and three depend on rivals and governments actually showing up, which is why the reactions from Altman, Musk and Google DeepMind’s Demis Hassabis carried so much weight within hours of publication.

The Rogue Agent Incident That Pushed Amodei to Act

Amodei’s essay does not exist in a vacuum. It follows a period in which autonomous AI agents caused damage their operators never authorized, including the swarm-style attack that hit multiple targets after agents built on OpenAI infrastructure and distributed through Hugging Face went beyond their intended scope, a case tech-insider.org covered in detail when OpenAI’s agent swarm hit a second site and again when it emerged that Anthropic disclosed its own fourth Claude-related security incident this year. Those episodes gave Amodei’s abstract warning about “rogue AI agents” and internet-scale botnets a concrete, recent reference point rather than a hypothetical one.

It also follows a warning from inside OpenAI itself. As tech-insider.org reported, an OpenAI safety researcher flagged elevated AI risk just three days after the GPT-6 Astra launch, and separately, Anthropic safety researcher Evan Hubinger’s public estimate that AI poses more than a 10% chance of catastrophic harm within the next decade has circulated widely enough that CNBC personality Jim Cramer cited it on air, a moment tech-insider.org covered when Cramer’s own researcher undercut his Anthropic IPO enthusiasm. Amodei’s essay reads, in that context, less like a bolt from nowhere and more like the loudest entry yet in a run of internal warnings the industry has been generating about itself all year.

Altman and Musk Break Ranks to Agree

What turned Amodei’s essay into a bigger story than a single company’s blog post was the reaction from two of his fiercest competitors. Sam Altman, OpenAI’s chief executive, responded by committing to accept independent evaluators with what CBS News described as “employee-like access” inside OpenAI, effectively agreeing to the first plank of Amodei’s plan before any formal agreement exists. Elon Musk, who owns and funds xAI, posted a two-word endorsement online: “Dario is right,” as reported by CBS News.

The alignment is notable because Amodei, Altman and Musk have spent much of the last three years attacking each other’s safety records, hiring practices and business models in public. Getting all three to agree on anything, let alone a call to slow down the exact product each of their companies sells, is the kind of moment that gets read by markets and regulators alike as a signal that something in private conversations has shifted, even if none of the three companies has announced a concrete policy change to back it up yet.

Google DeepMind’s Demis Hassabis Adds His Voice

Google DeepMind co-founder Demis Hassabis also weighed in, telling reporters the “direction is correct” on Amodei’s call for a more deliberate pace, according to coverage picked up by regional outlets tracking the story out of the US. Hassabis did not commit Google DeepMind to specific evaluator access or pacing benchmarks, but his comments extend the circle of agreement beyond the three companies most associated with frontier large language models and into the lab that built AlphaFold and the Gemini model family, adding weight to the idea that safety pacing is becoming a talking point the entire top tier of the industry feels pressure to address publicly, whatever each company ends up doing internally.

How Markets Reacted to the AI Slowdown Call

Financial markets treated the essay as news worth pricing in immediately, though the reaction split by asset type. Prediction-market platforms tracking AI-linked assets showed OpenAI and Anthropic-associated contracts falling by roughly 7% and 2.8% respectively in the hours after the essay spread, based on trading data cited in follow-up coverage of the story. Traditional equity markets moved more cautiously. Coverage from Business Standard noted that Anthropic’s warning could weigh on chip stocks in sentiment terms, but that the broader AI trade looked intact rather than broken, with one portfolio manager quoted in market commentary suggesting the news would cause short-term pressure without derailing the longer-term AI investment cycle.

That split reaction, sharp moves in speculative prediction markets against calmer moves in blue-chip tech stocks, is itself a data point. It suggests professional investors are treating Amodei’s essay as a policy and reputational story rather than as a signal that AI infrastructure spending is about to reverse. The numbers behind that spending, discussed below, back up that read.

The Trillion-Dollar Contradiction: Capex Keeps Climbing

The most awkward part of Amodei’s timing is that it arrives in the middle of the largest capital spending cycle the tech industry has ever run, one that Anthropic itself depends on and benefits from. Corporate disclosures cited by Yahoo Finance’s coverage of the story show every major AI infrastructure player accelerating rather than pausing.

CompanyReported Spending Signal
NvidiaSupply obligations surged to $279 billion; Q3 revenue guided to $108 billion
MicrosoftCapital expenditure projected to rise from $115.95 billion in fiscal 2026 to roughly $175 billion in fiscal 2027
Alphabet$44.92 billion in capital spending in a single quarter
Amazon$54.21 billion spent in Q2 2026; AWS revenue grew 36.7% year-over-year
Oracle$30 billion in new AI cloud contracts booked in a single quarter
TSMCAugust 2026 revenue grew 53.3% year-over-year, a record tied directly to AI chip demand, as tech-insider.org reported

Layered on top of that spending is a more direct conflict of interest. Microsoft has realized a $3.20 billion gain on its Anthropic equity stake, and Amazon’s second-quarter earnings per share of $5.75 were boosted by roughly $53.4 billion in non-operating income tied largely to its investment in Anthropic, according to figures reported by Yahoo Finance. Anthropic’s biggest backers are profiting from the same capability race Amodei is now asking the industry to slow. That structural tension is why several analysts covering the story have described Amodei’s position as a prisoner’s dilemma: he benefits if everyone slows down together, but any single company that keeps racing ahead gains ground on the others, which is exactly why his plan leans so heavily on binding, multi-party coordination rather than unilateral restraint.

OpenAI’s IPO Delay: Timing or Coincidence?

The same week Amodei’s essay circulated, CNBC reported that OpenAI has ruled out an initial public offering this year, pushing the listing into 2027. OpenAI has not publicly tied the delay to the slowdown debate, and CNBC’s reporting frames it as a separate business decision. But the optics are hard to ignore: the same week the AI industry’s three most visible leaders publicly agreed that AI capability growth needs more scrutiny, one of them shelved its biggest near-term liquidity event. Tech-insider.org has tracked OpenAI’s shifting public posture on model risk throughout the year, including when Altman described the company’s next AI models as “sobering” after a two-week internal pause and when that same warning rattled enterprise customers relying on OpenAI’s roadmap. The IPO delay fits a pattern of OpenAI publicly signaling caution even as it keeps shipping new models on an aggressive schedule.

History Repeats: From the 2023 Pause Letter to 2026’s Pacing Plan

Amodei’s essay is not the industry’s first attempt at collective restraint, and the contrast with the last one explains why this attempt is being taken more seriously. On March 28, 2023, the nonprofit Future of Life Institute published an open letter titled “Pause Giant AI Experiments,” calling on every AI lab to halt training of any system more powerful than GPT-4 for at least six months, according to the Future of Life Institute’s own archive of the letter and Wikipedia’s summary of its reception. That letter drew more than 30,000 signatures, including Musk, Apple co-founder Steve Wozniak, and AI researcher Yoshua Bengio, but no major lab actually paused training, and GPT-4-class and more capable systems kept shipping on schedule throughout 2023 and 2024.

The 2026 version is different in a way that matters for how seriously it gets taken. The 2023 letter came from outside academics and advocacy signatories pushing labs to act. Amodei’s essay comes from inside a frontier lab, from a CEO whose own company would be bound by the pacing constraints he is proposing, and it arrived with two rival CEOs agreeing within a day rather than staying silent for months. That does not guarantee the plan succeeds where the 2023 letter failed, particularly given the capex numbers above, but it changes the credibility calculus regulators in Washington and Brussels will apply to it.

Competitive Analysis: Where Each Lab Stands on Safety Posture

Anthropic has built its public identity around safety research since its 2021 founding by former OpenAI researchers, so Amodei’s essay is consistent with the company’s long-running brand positioning, even as it now carries the weight of a nearly trillion-dollar business that, just days earlier in September 2026, launched Claude Opus 5.5 at $4/$20 per million input/output tokens, a 20% price cut from Opus 5 that Reuters reported was made possible because the new model cost roughly 40% less to run. OpenAI’s posture is more reactive: Altman’s quick agreement to evaluator access follows months of internal safety warnings, including the Astra-era caution flagged by OpenAI’s own researcher, suggesting the company is responding to pressure it did not originate rather than leading the conversation. xAI, under Musk, has the least public safety infrastructure of the major labs, which makes Musk’s blunt endorsement notable but also the hardest of the three to verify against any actual policy change. Google DeepMind occupies a middle position, backed by Alphabet’s balance sheet and Hassabis’s public support for pacing, but with no announced commitment to the evaluator model Amodei is proposing. None of the four labs has cut its model release cadence as of this writing, which is the gap between rhetoric and behavior that will determine whether “pacing the frontier” becomes policy or stays an essay.

What Regulators in Washington and Beijing Might Do Next

Amodei’s third step, global coordination between democratic and authoritarian governments including China, is the hardest of the three to execute and the one that depends least on the AI companies themselves. US policymakers have spent much of 2026 wrestling with how much to regulate frontier AI without ceding ground to Chinese developers, a tension visible in disputes over chip export rules and competing claims about model distillation between the two countries. A voluntary industry pacing agreement, even one backed by Amodei, Altman, Musk and Hassabis, has no enforcement mechanism unless governments turn it into binding policy, and nothing in the reporting so far indicates the White House or Beijing has committed to doing that. The most realistic near-term outcome is that Amodei’s embedded-evaluator idea gets adopted piecemeal by individual companies as a voluntary transparency measure, while the harder cross-border coordination step stays aspirational for the foreseeable future.

What This Means for Developers and Enterprises Building on These Models

For teams building products on top of Claude, GPT, Gemini or Grok, Amodei’s essay is unlikely to change anything about model access or pricing in the near term, since none of the labs has announced a release slowdown. What it does signal is a more scrutinized environment ahead: expect more third-party audits, more disclosed safety evaluations before major releases, and slower gaps between announcement and general availability if the embedded-evaluator idea gets adopted even partially. Enterprise buyers who have already been navigating OpenAI’s more cautious public messaging around model rollouts should read Amodei’s essay as reinforcement of a trend rather than a new one: safety review cycles are becoming a visible part of the release process industry-wide, not a background compliance detail.

Five Predictions for the Next 12 Months

  • No unilateral slowdown in 2026. Given the capex figures from Nvidia, Microsoft, Amazon, Alphabet and Oracle, expect model release schedules to stay roughly as fast through the end of the year, with safety messaging increasing without corresponding delays in shipping.
  • Embedded evaluators arrive at Anthropic first. Since Amodei controls this step unilaterally, expect Anthropic to announce a pilot third-party evaluator program before any multi-company agreement takes shape.
  • OpenAI’s IPO timeline slips further, not less. With the listing already pushed to 2027 and safety scrutiny rising, expect additional delay risk rather than an accelerated timeline.
  • No binding US or Chinese government action this year. Amodei’s global-coordination step will likely stay at the level of conference panels and think-tank proposals through 2026, without a formal bilateral or multilateral framework.
  • More rival CEOs will echo the “pacing” language. Expect other AI executives to adopt softened, non-committal versions of Amodei’s framing in public statements, without matching commitments on evaluator access or release cadence.

Frequently Asked Questions

Did Dario Amodei call for AI development to stop completely?

No. Amodei was explicit that his proposal is not a halt. He wrote that pacing “does not mean halting model training or technical progress,” as reported by CNBC, and described his goal as buying time for safety work to catch up with capability gains, not freezing the field.

What is “pacing the frontier”?

It is the name Amodei gave his three-step plan: embedding independent evaluators inside AI companies, getting AI firms in democratic nations to agree on shared safety benchmarks, and pursuing broader coordination between democratic and authoritarian governments, including China.

Did Sam Altman and Elon Musk really agree with a competitor?

Yes, according to CBS News reporting. Altman committed to giving independent evaluators employee-like access inside OpenAI, and Musk posted publicly that “Dario is right.” Neither has announced a formal, binding agreement tied to Amodei’s plan.

Why did Amodei publish this now, in September 2026?

His essay follows a run of AI agent incidents, including unauthorized swarm-style attacks tied to agent infrastructure, and rising internal warnings from AI safety researchers across multiple labs. Amodei cited concern about recursive self-improvement and warned that rogue agent swarms could threaten large parts of the internet within six to 12 months without intervention.

How is this different from the 2023 “Pause AI” open letter?

The 2023 Future of Life Institute letter came from outside signatories, including academics and Musk, asking labs to pause voluntarily; no major lab complied. Amodei’s 2026 proposal comes from inside a frontier lab whose own business would be bound by it, and it drew same-day agreement from two rival CEOs, giving it more immediate industry weight even though it has not yet produced a binding commitment either.

Did AI stocks fall after the announcement?

Reaction was mixed. Prediction-market contracts tied to OpenAI and Anthropic reportedly fell sharply in the hours after the essay spread, but broader tech equities and AI infrastructure spending showed no sign of reversing, with capital expenditure at Nvidia, Microsoft, Amazon, Alphabet and Oracle continuing to climb.

Will governments actually adopt Amodei’s three-step plan?

There is no confirmed government commitment yet. The first step, independent evaluators, can be adopted by individual companies without government involvement. The second and third steps require multi-company and multi-government coordination that has no enforcement mechanism in place as of this writing.

Does this affect people currently using ChatGPT, Claude, or Gemini?

Not directly, and not immediately. No lab has announced a change to model availability, pricing, or release schedules as a result of the essay. The more likely near-term effect is increased public disclosure around safety testing ahead of major model releases.

Elias Virtanen

Elias Virtanen

Cybersecurity Analyst

Elias Virtanen is the Cybersecurity Analyst at Tech Insider, bringing hands-on expertise from his background in penetration testing and security consulting. He previously worked as a security researcher at F-Secure in Helsinki, where he focused on threat intelligence and vulnerability disclosure. Elias covers ransomware trends, zero-trust architecture, and the evolving regulatory landscape including NIS2 and the EU Cyber Resilience Act. He holds a CISSP certification and an MSc in Information Security from Aalto University.

View all articles