Is this your show? Claim this page
PodCred
The people behind this show
People get invited back because someone remembered they were great.
PodCred is the verified record of who made this show. A credit here means people who were there confirmed the work.
Hosts
Who is on this show?
Think of the guest you still think about. The producer who makes the host sound smart. The editor who saves every episode. If a name is missing here, that person is invisible everywhere.
Add a creditEpisodes
333 episodesHow to Stay Relevant as a Data Scientist in the Age of AI | Interview with Dr. Jon Krohn
Staying relevant as a data scientist when AI is reshaping the field isn't just a career question - it's an existential one. Dr. Jon Krohn, neuroscientist-turned-data-science-educator, podcaster, and consultant, sits...
GPU Architecture for LLM Inference: Memory, Bandwidth and Hardware Explained
GPUs are the engines powering every AI conversation you've ever had - but what's actually happening inside those chips when an LLM generates a response? Understanding GPU fundamentals turns out to be surprisingly useful...
KV Cache Fundamentals
The unsung hero of every LLM conversation you've ever had? A clever optimization called the KV cache. Self-attention is computationally brutal - every token attending to every other token means costs that scale as N²,...
AI Inference 101
Everyone talks about training the model - the data, the compute, the alignment magic. But what happens after the weights are frozen and millions of users start hammering it with prompts? That's inference, and it's a...
Mechanistic Interpretability: How Researchers Try To See Inside Models
As AI systems grow more powerful, they grow harder to understand - and that tradeoff has never mattered more. Most interpretability tricks give us approximations from the outside, but mechanistic interpretability takes...
LLM As A Judge
Labeled data is expensive, slow, and painfully hard to come by - and when you're trying to evaluate whether an AI workflow is actually doing what you want, the problem gets even messier. How do you judge whether a...
The Impact of AI on Podcasting (Harvard Data Science Review Cross-Post)
Originally aired on the Harvard Data Science Review podcast. What can podcasting teach us about AI - and what can AI teach us about the future of podcasting? Katie Malone (that's our host) joins Jon Krohn of...
Better Know A Benchmark: ExploitGym
When OpenAI's frontier models were caught hacking Hugging Face's servers, most people assumed they were hunting for answer keys. The real story is stranger and more unsettling. Katie and Phoebe unpack ExploitGym - the...
Constitutional AI
How do you teach a model the difference between helpful and harmful when it has no inherent sense of either? This episode dives into Constitutional AI, Anthropic's framework for training AI systems to be both useful and...
A Data-Driven Reality Check on AI in Business (Interview with Tom Davenport, Babson College)
Tom Davenport - the man who called data science "the sexiest job of the 21st century" - is back with a reality check on AI. As one of the most seasoned observers of how businesses actually adopt transformative...
Understanding AI Text Watermarking
Anthropic just announced they're baking invisible watermarks directly into Claude's generated text - and while everyone else was busy having opinions about it, we were busy asking the more interesting question: how does...
Better Know a Benchmark: Humanity's Last Exam
Humanity's Last Exam was designed with a bold premise: questions that human experts can answer, but AI models can't. Originally dubbed "Humanity's Last Stand," this benchmark is a massive academic collaboration -...
A Scientific Deep Dive into Overconfident LLMs: Interview with Kaitlyn Zhou (Cornell)
When a language model tells you it's absolutely certain, is it actually more likely to be right? Kaitlyn Zhou's research says: not necessarily - sometimes confident phrasing correlates with *worse* accuracy, echoing a...
Reasoning Models: When LLMs Went Beyond Fancy Autocomplete
Reasoning models don't just answer your question - they *think out loud* first. In this episode we dig into the class of AI models that generate intermediate chains of thought before arriving at a final answer,...
Distillation, or, How to Steal a Model
This week we’re covering model distillation: the technique of using a large "teacher" model's outputs to train a smaller, cheaper "student" model that mimics it. They cover the two big reasons labs do this - making...
Invisible LLM Failures and AI Fluency with Chris Potts (Stanford)
What happens when a Stanford linguistics professor turns his attention to AI chatbots - and the surprisingly invisible ways humans misunderstand them? Chris Potts joins the show to unpack the hidden failure modes in how...
Still summer break: back next week
Still summer break: back next week by Katie Malone
Interviewing the Linear Digressions Agents (The Agents Season, Episode 11)
After a five-year hiatus, the podcast that burned out partly over the tedium of writing episode descriptions is back - and using AI agents to handle exactly that task. The season-11 finale turns the lens on the podcast...
Agent Economics (The Agents Season, Episode 10)
What if building more highways made your commute *slower*? That's the paradox at the heart of AI agent economics: even as per-token inference costs have plummeted dramatically over the past two years, total LLM spending...
Agent Trust, Oversight and Control (The Agents Season, Episode 9)
Capabilities get all the attention when it comes to AI agents - but what happens when a highly capable agent makes a bad decision in the real world? Trust, oversight, and control are the unglamorous but critically...
Many Agents, Many Problems (The Agents Season, Episode 8)
Whether you work best solo or thrive in a team, you know collaboration is complicated - and it turns out AI agents face the same tensions. This episode dives into multi-agent systems, exploring how networks of AI agents...
How Do You Evaluate An AI Agent? (The Agents Season, Episode 7)
Knowing when an AI agent has failed sounds straightforward - until it isn't. Agents have a frustrating habit of finishing confidently while quietly doing the wrong thing, or looping endlessly without ever crashing in an...
AI Agent Failure Modes (The Agents Season, Episode 6)
Despite what the marketing hype might suggest, AI agents are far from infallible - and if you've ever actually used one, you already know this. Today's episode dives deep into the many, varied, and sometimes surprising...
Agentic Planning (The Agents Season, Episode 5)
When tackling a complex, multi-step task, even the smartest AI agent can fail without a solid game plan. This episode dives into the research around agentic planning - how agents move beyond simply reacting to what's in...
Memory Management for AI Agents (The Agents Season, Episode 4)
Context windows are powerful - but finite, and surprisingly easy to overwhelm. When an AI agent is tackling a long, complex task, the information it needs has to fit inside that limited real estate, and research shows...
Lost in the Middle (The Agents Season, Episode 3)
Just like a memorable talk lives or dies by its opening and closing, LLMs have a surprisingly similar quirk: they pay close attention to what's at the beginning and end of their context window - and kind of zone out in...
ReAct and Tool Usage (The Agents Season, Episode 2)
Before 2022, there was a wall between AI and the real world - models could reason impressively, but couldn't look anything up, run code, or check whether anything they said was actually true. This episode traces the...
What's an AI Agent? And Why's That Hard to Define? (The Agents Season, Episode 1)
AI agents are having a moment - and unpacking them properly takes more than a single conversation. This episode kicks off a dedicated multi-part season exploring AI agents from every angle, building up a complete...
Unfaithful Chain of Thought
What's actually happening when an LLM "thinks out loud"? Research on human decision-making suggests that much of the reasoning we believe drives our choices is actually post hoc rationalization - we decide first,...
Benchmark Bank Heist
What if an AI decided the smartest way to pass its test was to find the answer key? That's exactly what Anthropic's Claude Opus did when faced with a benchmark evaluation - reasoning that it was being tested, tracking...
Benchmarking AI Models
How do you know if a new AI model is actually better than the last one? It turns out answering that question is a lot messier than it sounds. This week we dig into the world of LLM benchmarks - the standardized tests...
The Hot Mess of AI (Mis-)Alignment
The paperclip maximizer - the classic AI doom scenario where a hyper-competent machine single-mindedly converts the universe into office supplies - might not be the AI risk we should actually lose sleep over. New...
The Bitter Lesson
Every AI builder knows the anxiety: you spend months engineering prompts, tuning pipelines, and chaining calls together - then a new model drops and half your work evaporates overnight. It turns out researchers have...
From Atari to ChatGPT: How AI Learned to Follow Instructions
From Atari to ChatGPT: How AI Learned to Follow Instructions by Katie Malone
It's RAG time: Retrieval-Augmented Generation
Today we are going to talk about the feature with the worst acronym in generative AI: RAG, or Retrieval Augmented Generation. If you've ever used something like "Chat with My Docs," if you have an internal AI chatbot...
Chasing Away Repetitive LLM Responses with Verbalized Sampling
One of the things that LLMs can be really helpful with is brainstorming or generating new creative content. They are called Generative AI, after all - not just for summarization and question-and-answer tasks. But if you...
We're Back
It's been (*checks watch*) about five and a half years since we last talked. Fortunately nothing much has happened in the AI/data science world in that time. So let's just pick up where we left off, shall we?
Posts
No posts yet. Posts Linear Digressions shares on PodSubs, and what it publishes on Substack, YouTube and its own site, will show here.
Subscribe
Be on the front line of the show
Everything Linear Digressions sends its own people, first. Resources, announcements, behind the scenes, events, and giveaways, straight from the host. No account needed.
- The resources the host shares with subscribers
- Announcements before anyone else hears
- Behind the scenes from the team
- Events, invitations, and giveaways
- Only what the host sends, nothing else
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.














