Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

The Human in the Loop

The Human in the Loop artwork

The Harness Problem

Aug 23, 202622 minAudio
ShareXLinkedInFacebookWhatsAppEmail

This week's biggest AI upgrade wasn't a model. It was someone reviewing code differently. Grok, Gemini, and GPT all shipped new versions in the same seven days. I skimmed the benchmarks. Forgot most of them within the hour. What stuck was smaller. Fred Schott released Flue 2, a hook-based agent framework. Simon Willison wrote about how he reviews agent-written code now. Not the same checks he runs on a human's pull request, not the same pace, not the same default trust. Two different people, two different projects. Same discovery underneath. Neither of them upgraded a model. They upgraded what happens around it. I keep watching teams do the opposite. New model, same shell script duct-taped to it. Same review habits built for commits that land twice a day, now pointed at code that shows up ten times faster and doesn't get tired or embarrassed when it's wrong. That's not a tooling gap. That's a process nobody rebuilt. If your agent produces a bad tool call right now, what actually catches it? A human watching the terminal? A test suite that was never written for this? Or nothing? More on this in this week's episode of The Human in the Loop. #TheHumanInTheLoop #AIAgents #SoftwareEngineering

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Who Understood the Code? Rethinking Engineering Interviews

    Nov 1, 202619 minAudio

    If an agent can solve your interview puzzle in seconds, what are you actually measuring? This week an Anthropic engineering manager, Felix Rieseberg, wrote that he stopped using coding interviews for his team. Claude...

    Credit the people on this episode

  2. Git’s best feature was slowing down Anthropic’s machines

    Oct 18, 202624 minAudio

    Git was built for a developer on a train. Every copy works offline. That was the point. Anthropic says its merges went from about 2,500 a day in May to over 30,000 by September. Most of the clients are now agents and CI...

    Credit the people on this episode

  3. The 49% Problem: Who Reviews What the Agents Write?

    Oct 11, 202623 minAudio

    AI coding agents wrote more code. Human review time went up 49%. That comes from a study covered by Ars Technica. I could not trace the original, so treat the numbers as reported. Lines of code: up about 30%. Pull...

    Credit the people on this episode

  4. Can You Explain It?" Airbnb's One Rule for AI-Written Code

    Oct 4, 202622 minAudio

    Airbnb's CTO says 60% of its code is now AI-written. He has one rule for it. Ahmad Al-Dahle shared this in a Latent Space interview this week. Features shipped: up nearly 80% year over year. Pull-request throughput: up...

    Credit the people on this episode

  5. Your AI Agent Doesn't Know What Its Code Does

    Sep 27, 202618 minAudio

    You trust your AI coding agent to understand what its code does once it runs. A new benchmark says that trust is misplaced most of the time. Researchers built SWE-Flux to test it: 480 questions across 12 real Python...

    Credit the people on this episode