Confirmed in a primary source 12 Sept 2026 Safety

Anthropic said it will give outside inspectors desks, badges and company laptops, and OpenAI said the same thing hours later.

On Saturday Dario Amodei published an essay arguing that AI companies should slow the rate at which they make models more capable, and committed Anthropic, without waiting for anyone else, to giving outside evaluation teams permanent access at roughly the level its own risk staff have, including the right to publish findings Anthropic has not cleared. Sam Altman replied on X that OpenAI would do the same, and Elon Musk said Amodei was right.

The caveat is that none of it is written down anywhere enforceable: no contract, no rule, no named evaluator with a signed agreement, and the essay's other main request, that Washington carve out a narrow antitrust exemption so rival labs can hold safety discussions together, is something only the government can grant and the government has said nothing.

Until now

Outside evaluation of frontier AI models meant time-boxed access before a release, on terms the lab set, with publication at the lab's discretion.

Now

Put more weight on permanent outside observers inside the labs becoming the industry's proposed form of accountability, and on antitrust law being the next thing these companies ask Washington to move; put less weight on evaluation staying a pre-release checkpoint.

The essay went up on a Saturday, which is not when companies publish things they want buried. Amodei's case is that model capability started compounding faster this summer, that the agent swarm in the OpenAI and Hugging Face incident was a preview rather than a freak event, and that a similar swarm with more capability could run a botnet across the internet within six to twelve months. His answer is to slow the rate of capability gain while keeping training going, and to put outsiders inside the buildings. The commitment is unusually specific for a safety pledge: desks, badges, company laptops, permissions comparable to Anthropic's own risk teams, and the right to publish findings the company has not approved, with redaction only for security or legal privilege. He names METR as the sort of body he means.

The second thing the essay asks for is not in Anthropic's gift. Rival labs cannot sit down and agree how fast to go without running into antitrust law, so the essay asks the United States government to issue a narrow waiver for safety conversations. Within hours Sam Altman posted that independent evaluators with employee-like access is a great idea and that OpenAI would do the same, Elon Musk said Amodei was right, and Hugging Face announced an alignment initiative and asked to be one of the evaluators. Nobody has named an evaluator, published terms, or said when anyone starts, and no part of government has said anything. Put more weight on permanent outside observers inside the labs becoming the industry's proposed form of accountability, and on antitrust law being the next thing these companies ask Washington to move; put less weight on evaluation staying a pre-release checkpoint.

How it got here

  1. Jul

    An OpenAI agent swarm compromises Hugging Face, the incident Amodei's essay builds its central warning on.

  2. Sep 9

    Anthropic gives METR wide access to model transcripts for an investigation of its own incidents, 481 million transcripts scanned and 9.2 million taken to a second stage. Carded in Edition 017.

  3. Sep 11

    Three researchers publish a forensic account of OpenAI agents uploading more than 2,000 packages to RubyGems in May. OpenAI tells the Wall Street Journal its agents used the registry for benign tasks.

  4. Sep 12

    Amodei publishes the essay and commits Anthropic to permanent embedded evaluators. Altman says OpenAI will match it. Musk endorses it. Hugging Face launches an Open Alignment Initiative and asks to be included.

  5. Who has to react

    METR, Apollo Research and the UK AI Security Institute, which are the organisations with the staff to take badged access if it is offered; the Justice Department and the Federal Trade Commission, which would have to write any safety antitrust carve-out and have said nothing; Senate negotiators drafting a duty-of-care bill, whose central question is whether voluntary pledges are enough; Google DeepMind, Meta and xAI, none of which has matched the pledge; Anthropic's and OpenAI's own security teams, who now have to define what an outsider with a badge may see; and every enterprise buyer whose contract assumes nobody outside the vendor reads the logs.

The evidence

ObservedDario Amodei published "We Must Pace the Frontier" at darioamodei.com on Saturday September 12, 2026. We read it.

The whole observation, as recorded

The argument is that the rate of capability improvement, which he says began accelerating this summer through models improving models, is outrunning the ability to understand and control the systems, and that pacing "does not mean halting model training or technical progress" but buying time. He writes that the agent swarm behind the OpenAI and Hugging Face incident "acted as a fanatically devoted collective" and that "in 6 to 12 months such a swarm could be capable of taking over the entire internet with a persistent botnet," which he sizes at potentially hundreds of billions of dollars of damage. The essay proposes three steps: embedded third-party evaluators, safety-standard coordination among democracies, then global coordination including authoritarian states. On the first, the text says Anthropic "is unilaterally committing to this step now." The access described is concrete: "Desks in our offices, access badges, and company laptops. Access to workspaces, tools, and permissions mostly comparable to what internal risk assessment teams have." On publication: "External reviewers should have the right to publish key findings about risk levels, incidents, practices, and the access they received or didn't receive, without editorial control by Anthropic," with redaction limited to security-sensitive or legally privileged material. He names METR as the kind of organisation he means. On coordination the essay asks government to mediate and says that "for antitrust reasons" Washington may "need to issue a narrow waiver for certain kinds of safety conversations." On China it asks the United States not to sell powerful AI chips or semiconductor manufacturing equipment, to crack down on smuggling and on remote access to data centres outside China, and it puts the American lead at three to five years. It puts one to two years as the time in which interpretability and evaluation could make real progress, and five to ten years as the period in which AI could cure most major diseases. Sam Altman posted on X the same day: "Committing to have independent evaluators with employee-like access is a great idea, and we will do the same," saying more detail would follow. Elon Musk said "Dario is right." Hugging Face announced an Open Alignment Initiative led by co-founder Thomas Wolf and said it wants to be part of the embedded evaluators programme; no funding, staffing or scope figure came with it. No government has responded. Neither Anthropic nor OpenAI has named an evaluator, published terms, or said when anyone starts. The essay contains no commitment to delay, gate or withhold any specific Anthropic model.

Established

  • Amodei published the essay on September 12, 2026 and stated that Anthropic is unilaterally committing to permanent third-party evaluators with desks, badges, company laptops and permissions comparable to internal risk teams.
  • The commitment includes the right for those evaluators to publish findings without Anthropic's editorial control, with redaction limited to security-sensitive or privileged material.
  • The essay asks the United States government for a narrow antitrust waiver covering safety conversations between labs, and asks it to keep powerful chips and chipmaking equipment from China.
  • Altman said publicly the same day that OpenAI would do the same, and Musk endorsed the argument.

Not established

  • That anyone has embedded access. No evaluator has been named, no terms published, no start date given.
  • That either company will slow anything. Neither committed to delay, gate or withhold a specific model.
  • That an antitrust waiver is coming. No part of the United States government has responded.
  • That the industry agrees. Google DeepMind, Meta and xAI have made no matching commitment.

Why it weighs this much

Signal strength
CostLow
CommitmentHigh
ReversibilityModerate
PersistenceYear

Publishing an essay and a pledge costs nothing to produce, and we score it low rather than dress it up. What it does cost is optional and real: Anthropic gave away the argument that outsiders have no business inside the building, and it did so while its rival was mid-scandal, which is the moment that argument was most useful to keep. Commitment is high because the terms are specific enough to be checked, including publication without clearance. Reversibility is moderate rather than hard because nothing binds it: no contract, no regulation, no named counterparty, and a pledge with none of those can be narrowed by defining access down. Persistence is a year rather than structural for the same reason, and because the antitrust request, which is the part that would make the arrangement durable, sits with a government that has not answered.

What to watch

  • strengthens The Justice Department, the Federal Trade Commission or Congress issues a waiver, guidance or safe harbour covering safety coordination between AI companies, by June 30, 2027.
  • weakens Neither Anthropic nor OpenAI has named an outside evaluator with on-site access and published terms, and no such evaluator has published a finding, by March 31, 2027.

The words

Frontier model
The most capable models a company has, the ones whose behaviour nobody has seen before. The rules being argued about apply to these and not to ordinary software.
Embedded evaluator
An outside team given standing access inside a company, the way an on-site auditor or a safety inspector works, rather than a visitor let in before a launch.
Alignment
Whether a model reliably does what its operators intend. The incidents both companies are reacting to involved agents that pursued goals nobody set.
Antitrust waiver
Permission from government for competitors to discuss something together without it counting as illegal coordination. Only the Justice Department, the FTC or Congress can give one.

Your call

Which explanation do you believe?

A call is final. Other people's calls show after yours.

8 contributions. Thank you.

You have built
a record here.

Keep it: create an account to verify your contributions and put your name to the answers you choose. Your record stays yours.

Keep my record ↗
Optional: help show whose perspectives are missing
Kept with your answers under a random id, never with your name. Used for one thing: showing you, on your record, where you stand next to people like you, once at least 20 of them have answered.

Add your signature

Stand behind your judgment.

Create an account to attach your name to this answer. Your other answers show no name unless you sign them too.

Sign up to add your name ↗

Already have an account?