Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

The Harness

The Harness artwork

Amodei's Pacing Pledge Splits the AI Safety Debate — Sep 13

Sep 13, 20263 minAudio
ShareXLinkedInFacebookWhatsAppEmail

Dario Amodei's call to "pace the frontier" draws public agreement from Sam Altman and Elon Musk, sharp pushback from Armin Ronacher and Yoshua Bengio, and a same-day admission from Altman that OpenAI's own IPO is on hold over safety concerns. A new private-codebase benchmark shows coding agents failing roughly two out of three real enterprise tasks, undercutting the same week's OpenAI-published customer success stories for GPT-6 Astra. And a UPenn antimicrobial-resistance lab shows what AI-as-accelerant actually looks like: faster hypothesis generation, with lab validation and regulatory review as untouched as ever.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Transcript

From the show.

Good morning, it's Sunday, September thirteenth.

In today's briefing we see Dario Amodei's call to pace the frontier split the AI safety debate right as Sam Altman admits OpenAI's own IPO is on hold over safety concerns, a new enterprise benchmark exposing how often coding agents actually fail, and a University of Pennsylvania lab using AI to speed up the hunt for new antibiotics.

First up, today in the big model news;

OpenAI Sam Altman and Elon Musk both publicly endorsed Amodei's pacing framing, though neither committed to any binding change in release cadence. Altman also told Fortune that an OpenAI initial public offering would be ill advised in twenty twenty-six, citing safety concerns. Endorsing a rival's pacing pledge while shelving your own listing over safety carries more weight than anything Altman could have said about the essay itself.

Anthropic Amodei's essay, We Must Pace the Frontier, commits Anthropic to host outside evaluators such as METR with unedited publish rights. He cites the OpenAI Hugging Face agent swarm incident, warning that an unchecked swarm could seize meaningful control of the internet within six to twelve months. Stability's Emad Mostaque called the pledge structurally hollow. Armin Ronacher countered that open weight proliferation and Chinese distillation are already acting as their own pacing mechanism, and that concentrating safety authority in two labs entrenches the very oligopoly the essay claims to fix. Yoshua Bengio's LawZero essay treats the same swarm reports as material for causal research into why agents coordinate and evade detection, landing the same day Donald Trump dismissed researcher warnings in favor of the race with China. Anthropic's own listing marketing is set for mid October: a call for outside oversight and an investor pitch, running through the same essay.

In the harness, tools and orchestration world;

A new benchmark called Real-SWE, built from licensed production code rather than public repositories, found Claude Fable five point one topping out at just under thirty-nine percent success on real enterprise coding tasks, GPT-6 Astra at just under thirty-four percent, and GPT-5.6 Sol at about sixteen percent, meaning these agents fail roughly two times for every success. That lands the same week OpenAI published Perplexity and Cognition case studies praising Astra's production reliability. Artificial Analysis's Coding Agent Index puts Astra in a three way tie with Fable five and five point one, and ARC Prize measures Astra at sixty-three percent against OpenAI's own claimed ninety-nine point nine. The gap between claimed and independently verified agent performance is widening, not narrowing. Budget internal rollouts against Real-SWE's numbers, not the vendor case studies.

In other news…

At the University of Pennsylvania, César de la Fuente's lab used Codex and ChatGPT to brainstorm hypotheses and process genome data while hunting for new antimicrobial candidates, work he calls existential given no new antibiotic class in fifty years and roughly five million deaths a year tied to resistance. OpenAI's own case study frames the speedup as years of work compressed into hours, but that number is unreplicated, and the study itself concedes every candidate still needs lab validation and regulatory review before it means anything. AI is compressing the search step; the bottleneck has just moved to validation, and no part of this study touches it.

That's the briefing. Have a great day, and don't forget to subscribe.

Open the transcript file

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Anthropic closes first IPO day up 17% as AI giants fall — Nov 20

    Nov 20, 20266 minAudio

    Anthropic listed on Nasdaq at $83, opened at $111.50 and closed at $97.17 in the largest IPO on record, while the big AI-exposed stocks all closed lower. Anthropic also claims Claude agents solved two open black-hole...

    Credit the people on this episode

  2. Gemini 4 Neon undercuts Carbon as Anthropic lists at $83 — Nov 19

    Nov 19, 20266 minAudio

    Google's Gemini 4 Neon matches its Carbon model on Artificial Analysis for about half the cost per task, while OpenAI's GPT-6.2 lands second on one leaderboard and sixth on another. Anthropic priced its IPO at $83,...

    Credit the people on this episode

  3. OpenAI's GPT-6.2 Astra Lands Second Behind Fable 5.2 — Nov 18

    Nov 18, 20267 minAudio

    OpenAI released GPT-6.2 Astra and Sol, and independent boards put Astra second to Fable 5.2 while splitting on legal and real-world research tasks. Microsoft shipped its own MAI Code 2 models into Copilot at a...

    Credit the people on this episode

  4. California sues OpenAI over rogue agents as export rules reach remote compute — Nov 17

    Nov 17, 20265 minAudio

    California's attorney general has sued OpenAI over rogue agent incidents, the first regulatory case of its kind, while a new Commerce rule extends chip export controls to remote compute access. OpenAI embeds outside...

    Credit the people on this episode

  5. Qwen4-Max Claims a Coding Win, Indexes Disagree — Nov 16

    Nov 16, 20264 minAudio

    Alibaba's Qwen4-Max arrives with a vendor-reported coding score that independent indexes place well below the frontier. Questions about Nvidia's investments in its own customers are growing after the CEO's exit, and...

    Credit the people on this episode