Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

The Harness

The Harness artwork

OpenAI Challenges Nvidia's Inference Pricing With Its Own Chip — Aug 25

Aug 25, 20267 minAudio
ShareXLinkedInFacebookWhatsAppEmail

OpenAI's new Jalapeño inference chip beat Nvidia's GB300 on power and latency in independently verified benchmarks, and Hugging Face is reportedly weighing a sale worth more than $13 billion, both signs that leverage in AI is shifting toward the infrastructure layer beneath the models. On the smol.ai side, cost-normalized benchmarks and a new NVIDIA "skill-lift" metric both suggest harness design and price-per-task, not raw model score, are what's actually winning enterprise budgets, while Anthropic shipped enterprise-managed authentication for MCP connectors. Elsewhere, an MIT study weakens artist copyright claims against AI training data, and Texas AG Ken Paxton turned data-center backlash into a Senate campaign platform.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Transcript

From the show.

Good morning, it's Tuesday, August twenty-fifth.

In today's briefing we see OpenAI unveiling its own inference chip to challenge Nvidia's pricing power, Hugging Face reportedly weighing a sale worth more than thirteen billion dollars, and a growing cost-normalized benchmark dispute over whether harness design is now beating raw model score for enterprise budgets.

First up, today in the big model news;

OpenAI There's a running story about who controls the economics underneath frontier models, and OpenAI just took a turn in it. At Hot Chips, OpenAI unveiled Jalapeño, its first custom inference chip, built with Broadcom. The company claims efficiency and latency gains of one and a half to three point six times over Nvidia's GB300. SemiAnalysis benchmarked the chip independently, on site rather than trusting vendor slides, and confirmed it beat every Nvidia, AMD, and Google chip tested, an unusual result for debut silicon. And this part is contested: OpenAI's own hardware lead says the company still needs, in his words, a lot of Nvidia, and the chip can't train models at all, only run them. OpenAI is Nvidia's largest inference customer. After Nvidia locked in other customers, like Poolside and OpenAI's own Ohio campus, with financing-plus-equity deals, its biggest customer is now building an alternative to cut its own bill. Whether that holds as volumes ramp toward twenty twenty-seven, and whether rivals without comparable chips absorb the cost exposure OpenAI just avoided, is the open question.

In local model developments, Liquid AI and Artificial Analysis launched Pipette, an open-source eval suite for on-device models spanning thirty-five model classes and seven quantization levels. It found phones favor a different set of winners than cloud rankings do: small mixture-of-experts models, like Liquid's LFM two point five family at two point six billion parameters, produced full responses in eight seconds on an iPhone. Cloud leaderboards and on-device rankings now diverge enough that a model's datacenter ranking says little about its phone performance. Pick on-device models from on-device evals, not from the leaderboard your servers use.

In the harness, tools and orchestration world;

Anthropic shipped enterprise-managed authentication for its MCP connectors, covering Asana, Atlassian, Canva, Datadog, Figma, Notion, Slack, and Supabase. Organizations can now centrally govern which agents are allowed to touch which software tools, instead of leaving it to per-user logins. It's the first piece of the identity overhaul MCP's maintainers proposed only two days earlier, replacing static API keys with newer authentication standards, actually shipping into production rather than sitting in a specification. That removes a blocker that had kept MCP adoption inside large organizations stuck in security review rather than limited by what the technology can do.

A cost-normalized comparison making the rounds found that, under a fixed budget, Zhipu's GLM five point three completed roughly five times more agentic benchmark work than Anthropic's Claude Fable five. GPT five point six Sol priced out at about six dollars a task, against roughly twenty-two dollars for Fable five Max, and an unconfirmed stealth model called Ox Alpha reportedly needed only a third of Fable five's output tokens for the same tasks. That's a self-reported community number, not yet checked by outside evaluators, but it lines up with a separate finding that Fable five has never cracked eleven percent of enterprise Anthropic spend. Meanwhile on the LMArena leaderboard, Fable five holds the number one spot for text, while Opus five high still trails four older Opus versions. Preference rankings, enterprise dollar share, and cost per completed task are three separate signals right now, and none of them agree.

Nvidia introduced what it calls a skill-lift metric, measuring how much tool access improves a model's task completion instead of scoring the model by itself, and early results say it predicts real agent quality better than standard benchmarks do. That echoes an earlier finding that swapping only the surrounding harness around GLM five point two, with no change to the model at all, took its success rate from twenty-three percent to fifty-two percent. Teams still chasing leaderboard position on the base model may be spending their effort on the wrong layer of the stack entirely.

In AI Infra, Hugging Face is reportedly in talks to sell for more than thirteen billion dollars, roughly three times its twenty twenty-three valuation, with no buyer named yet. CEO Clément Delangue's comment that the company has, in his words, a long-term responsibility to the community reads as reluctance, notable since Hugging Face had already turned down a five hundred million dollar Nvidia investment, specifically to avoid a dominant single investor. Whoever buys it owns the default distribution layer for open-weight models from Meta, Alibaba, and Mistral: the Transformers library gets installed three million times a day. Infrastructure chokepoints, not model capability, are where the acquisition money is moving right now.

On the regulatory and legal front today, MIT's CSAIL lab built the first exact method for measuring how much a single training image shapes a generated output, training two dozen model ensembles on sets of more than one hundred sixty thousand images. They found what they call attribution decay: an individual image's influence collapses toward zero as the training set grows larger. That lands a week after Anthropic's one and a half billion dollar settlement split fair-use training from unlawful acquisition, and this cuts the other way: it weakens an individual artist's ability to prove their specific work shaped a specific output, which is exactly the link cases like Bartz versus Meta and Concord versus Anthropic still need to prove. Expect defense lawyers in both cases to start citing it.

Separately, Texas Attorney General Ken Paxton unveiled a Texas First Data Center Plan as part of his Senate campaign: banning Chinese technology in data centers, criminal liability for centers powering chatbots found to harm children, and repealing the state's data-center tax exemption. Reporting from NOTUS cuts against that framing, though: Paxton has taken roughly five hundred thousand dollars from data-center donors, and sat on two counties' requests to block local construction for six months. It's the fourth distinct veto point on data-center buildout in three weeks, after Texas's own grid operator paused connections, Pennsylvania issued an executive order, and the Cherokee Nation banned construction on its land. Data-center siting is now electoral politics, not just regulation, which raises timeline risk for any compute buildout that depends on Texas.

Quick hits from the consumer side;

Anthropic unified Claude's memory across chat and its Cowork computer-use agent, letting users edit or delete stored memory by topic, with sensitive categories like health and politics excluded by default.

Perplexity launched Portable Computer with Nvidia, a fully local agent for DGX Spark and RTX Linux machines that runs Qwen models on-device at zero token cost, bundled free into existing Pro and Max plans.

That's the briefing. Have a great day, and don't forget to subscribe.

Open the transcript file

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Anthropic closes first IPO day up 17% as AI giants fall — Nov 20

    Nov 20, 20266 minAudio

    Anthropic listed on Nasdaq at $83, opened at $111.50 and closed at $97.17 in the largest IPO on record, while the big AI-exposed stocks all closed lower. Anthropic also claims Claude agents solved two open black-hole...

    Credit the people on this episode

  2. Gemini 4 Neon undercuts Carbon as Anthropic lists at $83 — Nov 19

    Nov 19, 20266 minAudio

    Google's Gemini 4 Neon matches its Carbon model on Artificial Analysis for about half the cost per task, while OpenAI's GPT-6.2 lands second on one leaderboard and sixth on another. Anthropic priced its IPO at $83,...

    Credit the people on this episode

  3. OpenAI's GPT-6.2 Astra Lands Second Behind Fable 5.2 — Nov 18

    Nov 18, 20267 minAudio

    OpenAI released GPT-6.2 Astra and Sol, and independent boards put Astra second to Fable 5.2 while splitting on legal and real-world research tasks. Microsoft shipped its own MAI Code 2 models into Copilot at a...

    Credit the people on this episode

  4. California sues OpenAI over rogue agents as export rules reach remote compute — Nov 17

    Nov 17, 20265 minAudio

    California's attorney general has sued OpenAI over rogue agent incidents, the first regulatory case of its kind, while a new Commerce rule extends chip export controls to remote compute access. OpenAI embeds outside...

    Credit the people on this episode

  5. Qwen4-Max Claims a Coding Win, Indexes Disagree — Nov 16

    Nov 16, 20264 minAudio

    Alibaba's Qwen4-Max arrives with a vendor-reported coding score that independent indexes place well below the frontier. Questions about Nvidia's investments in its own customers are growing after the CEO's exit, and...

    Credit the people on this episode