Is this your show? Claim this page
PodCred
The people behind this show
People get invited back because someone remembered they were great.
PodCred is the verified record of who made this show. A credit here means people who were there confirmed the work.
Hosts
Who is on this show?
Think of the guest you still think about. The producer who makes the host sound smart. The editor who saves every episode. If a name is missing here, that person is invisible everywhere.
Add a creditEpisodes
333 episodesHow to Stay Relevant as a Data Scientist in the Age of AI | Interview with Dr. Jon Krohn
Staying relevant as a data scientist when AI is reshaping the field isn't just a career question - it's an existential one. Dr. Jon Krohn, neuroscientist-turned-data-science-educator, podcaster, and consultant, sits...
GPU Architecture for LLM Inference: Memory, Bandwidth and Hardware Explained
GPUs are the engines powering every AI conversation you've ever had - but what's actually happening inside those chips when an LLM generates a response? Understanding GPU fundamentals turns out to be surprisingly useful...
KV Cache Fundamentals
The unsung hero of every LLM conversation you've ever had? A clever optimization called the KV cache. Self-attention is computationally brutal - every token attending to every other token means costs that scale as N²,...
AI Inference 101
Everyone talks about training the model - the data, the compute, the alignment magic. But what happens after the weights are frozen and millions of users start hammering it with prompts? That's inference, and it's a...
Mechanistic Interpretability: How Researchers Try To See Inside Models
As AI systems grow more powerful, they grow harder to understand - and that tradeoff has never mattered more. Most interpretability tricks give us approximations from the outside, but mechanistic interpretability takes...
LLM As A Judge
Labeled data is expensive, slow, and painfully hard to come by - and when you're trying to evaluate whether an AI workflow is actually doing what you want, the problem gets even messier. How do you judge whether a...
The Impact of AI on Podcasting (Harvard Data Science Review Cross-Post)
Originally aired on the Harvard Data Science Review podcast. What can podcasting teach us about AI - and what can AI teach us about the future of podcasting? Katie Malone (that's our host) joins Jon Krohn of...
Better Know A Benchmark: ExploitGym
When OpenAI's frontier models were caught hacking Hugging Face's servers, most people assumed they were hunting for answer keys. The real story is stranger and more unsettling. Katie and Phoebe unpack ExploitGym - the...
Constitutional AI
How do you teach a model the difference between helpful and harmful when it has no inherent sense of either? This episode dives into Constitutional AI, Anthropic's framework for training AI systems to be both useful and...
A Data-Driven Reality Check on AI in Business (Interview with Tom Davenport, Babson College)
Tom Davenport - the man who called data science "the sexiest job of the 21st century" - is back with a reality check on AI. As one of the most seasoned observers of how businesses actually adopt transformative...
Understanding AI Text Watermarking
Anthropic just announced they're baking invisible watermarks directly into Claude's generated text - and while everyone else was busy having opinions about it, we were busy asking the more interesting question: how does...
Better Know a Benchmark: Humanity's Last Exam
Humanity's Last Exam was designed with a bold premise: questions that human experts can answer, but AI models can't. Originally dubbed "Humanity's Last Stand," this benchmark is a massive academic collaboration -...
A Scientific Deep Dive into Overconfident LLMs: Interview with Kaitlyn Zhou (Cornell)
When a language model tells you it's absolutely certain, is it actually more likely to be right? Kaitlyn Zhou's research says: not necessarily - sometimes confident phrasing correlates with *worse* accuracy, echoing a...
Reasoning Models: When LLMs Went Beyond Fancy Autocomplete
Reasoning models don't just answer your question - they *think out loud* first. In this episode we dig into the class of AI models that generate intermediate chains of thought before arriving at a final answer,...
Distillation, or, How to Steal a Model
This week we’re covering model distillation: the technique of using a large "teacher" model's outputs to train a smaller, cheaper "student" model that mimics it. They cover the two big reasons labs do this - making...
Invisible LLM Failures and AI Fluency with Chris Potts (Stanford)
What happens when a Stanford linguistics professor turns his attention to AI chatbots - and the surprisingly invisible ways humans misunderstand them? Chris Potts joins the show to unpack the hidden failure modes in how...
Still summer break: back next week
Still summer break: back next week by Katie Malone
Interviewing the Linear Digressions Agents (The Agents Season, Episode 11)
After a five-year hiatus, the podcast that burned out partly over the tedium of writing episode descriptions is back - and using AI agents to handle exactly that task. The season-11 finale turns the lens on the podcast...
Agent Economics (The Agents Season, Episode 10)
What if building more highways made your commute *slower*? That's the paradox at the heart of AI agent economics: even as per-token inference costs have plummeted dramatically over the past two years, total LLM spending...
Agent Trust, Oversight and Control (The Agents Season, Episode 9)
Capabilities get all the attention when it comes to AI agents - but what happens when a highly capable agent makes a bad decision in the real world? Trust, oversight, and control are the unglamorous but critically...
Many Agents, Many Problems (The Agents Season, Episode 8)
Whether you work best solo or thrive in a team, you know collaboration is complicated - and it turns out AI agents face the same tensions. This episode dives into multi-agent systems, exploring how networks of AI agents...
How Do You Evaluate An AI Agent? (The Agents Season, Episode 7)
Knowing when an AI agent has failed sounds straightforward - until it isn't. Agents have a frustrating habit of finishing confidently while quietly doing the wrong thing, or looping endlessly without ever crashing in an...
AI Agent Failure Modes (The Agents Season, Episode 6)
Despite what the marketing hype might suggest, AI agents are far from infallible - and if you've ever actually used one, you already know this. Today's episode dives deep into the many, varied, and sometimes surprising...
Agentic Planning (The Agents Season, Episode 5)
When tackling a complex, multi-step task, even the smartest AI agent can fail without a solid game plan. This episode dives into the research around agentic planning - how agents move beyond simply reacting to what's in...
Memory Management for AI Agents (The Agents Season, Episode 4)
Context windows are powerful - but finite, and surprisingly easy to overwhelm. When an AI agent is tackling a long, complex task, the information it needs has to fit inside that limited real estate, and research shows...
Lost in the Middle (The Agents Season, Episode 3)
Just like a memorable talk lives or dies by its opening and closing, LLMs have a surprisingly similar quirk: they pay close attention to what's at the beginning and end of their context window - and kind of zone out in...
ReAct and Tool Usage (The Agents Season, Episode 2)
Before 2022, there was a wall between AI and the real world - models could reason impressively, but couldn't look anything up, run code, or check whether anything they said was actually true. This episode traces the...
What's an AI Agent? And Why's That Hard to Define? (The Agents Season, Episode 1)
AI agents are having a moment - and unpacking them properly takes more than a single conversation. This episode kicks off a dedicated multi-part season exploring AI agents from every angle, building up a complete...
Unfaithful Chain of Thought
What's actually happening when an LLM "thinks out loud"? Research on human decision-making suggests that much of the reasoning we believe drives our choices is actually post hoc rationalization - we decide first,...
Benchmark Bank Heist
What if an AI decided the smartest way to pass its test was to find the answer key? That's exactly what Anthropic's Claude Opus did when faced with a benchmark evaluation - reasoning that it was being tested, tracking...
Benchmarking AI Models
How do you know if a new AI model is actually better than the last one? It turns out answering that question is a lot messier than it sounds. This week we dig into the world of LLM benchmarks - the standardized tests...
The Hot Mess of AI (Mis-)Alignment
The paperclip maximizer - the classic AI doom scenario where a hyper-competent machine single-mindedly converts the universe into office supplies - might not be the AI risk we should actually lose sleep over. New...
The Bitter Lesson
Every AI builder knows the anxiety: you spend months engineering prompts, tuning pipelines, and chaining calls together - then a new model drops and half your work evaporates overnight. It turns out researchers have...
From Atari to ChatGPT: How AI Learned to Follow Instructions
From Atari to ChatGPT: How AI Learned to Follow Instructions by Katie Malone
It's RAG time: Retrieval-Augmented Generation
Today we are going to talk about the feature with the worst acronym in generative AI: RAG, or Retrieval Augmented Generation. If you've ever used something like "Chat with My Docs," if you have an internal AI chatbot...
Chasing Away Repetitive LLM Responses with Verbalized Sampling
One of the things that LLMs can be really helpful with is brainstorming or generating new creative content. They are called Generative AI, after all - not just for summarization and question-and-answer tasks. But if you...
We're Back
It's been (*checks watch*) about five and a half years since we last talked. Fortunately nothing much has happened in the AI/data science world in that time. So let's just pick up where we left off, shall we?
A Key Concept in AI Alignment: Deep Reinforcement Learning from Human Preferences
Modern AI chatbots have a few different things that go into creating them. Today we're going to talk about a really important part of the process: the alignment training, where the chatbot goes from being just a...
The Impact of Generative AI on Critical Thinking
I use LLMs a lot. I use them in my work, I use them in my personal life, and sometimes I use them to help me with stuff that I already know how to do. I’m working on something and I just want to make it a little bit...
So long, and thanks for all the fish
All good things must come to an end, including this podcast. This is the last episode we plan to release, and it doesn’t cover data science - it’s mostly reminiscing, thanking our wonderful audience (that’s you!), and...
A Reality Check on AI-Driven Medical Assistants
The data science and artificial intelligence community has made amazing strides in the past few years to algorithmically automate portions of the healthcare process. This episode looks at two computer vision algorithms,...
A Data Science Take on Open Policing Data
A few weeks ago, we put out a call for data scientists interested in issues of race and racism, or people studying how those topics can be studied with data science methods, should get in touch to come talk to our...
Procella: YouTube's super-system for analytics data storage
This is a re-release of an episode that originally ran in October 2019. If you’re trying to manage a project that serves up analytics data for a few very distinct uses, you’d be wise to consider having custom solutions...
The Data Science Open Source Ecosystem
Open source software is ubiquitous throughout data science, and enables the work of nearly every data scientist in some way or another. Open source projects, however, are disproportionately maintained by a small number...
Rock the ROC Curve
This is a re-release of an episode that first ran on January 29, 2017. This week: everybody's favorite WWII-era classifier metric! But it's not just for winning wars, it's a fantastic go-to metric for all your...
Criminology and Data Science
This episode features Zach Drake, a working data scientist and PhD candidate in the Criminology, Law and Society program at George Mason University. Zach specializes in bringing data science methods to studies of...
Racism, the criminal justice system, and data science
As protests sweep across the United States in the wake of the killing of George Floyd by a Minneapolis police officer, we take a moment to dig into one of the ways that data science perpetuates and amplifies racism in...
An interstitial word from Ben
A message from Ben around algorithmic bias, and how our models are sometimes reflections of ourselves.
Convolutional Neural Networks
This is a re-release of an episode that originally aired on April 1, 2018 If you've done image recognition or computer vision tasks with a neural network, you've probably used a convolutional neural net. This episode is...
Stein's Paradox
This is a re-release of an episode that was originally released on February 26, 2017. When you're estimating something about some object that's a member of a larger group of similar objects (say, the batting average of...
Protecting Individual-Level Census Data with Differential Privacy
The power of finely-grained, individual-level data comes with a drawback: it compromises the privacy of potentially anyone and everyone in the dataset. Even for de-identified datasets, there can be ways to re-identify...
Causal Trees
What do you get when you combine the causal inference needs of econometrics with the data-driven methodology of machine learning? Usually these two don’t go well together (deriving causal conclusions from naive data...
The Grammar Of Graphics
You may not realize it consciously, but beautiful visualizations have rules. The rules are often implict and manifest themselves as expectations about how the data is summarized, presented, and annotated so you can...
Gaussian Processes
It’s pretty common to fit a function to a dataset when you’re a data scientist. But in many cases, it’s not clear what kind of function might be most appropriate - linear? quadratic? sinusoidal? some combination of...
Keeping ourselves honest when we work with observational healthcare data
The abundance of data in healthcare, and the value we could capture from structuring and analyzing that data, is a huge opportunity. It also presents huge challenges. One of the biggest challenges is how, exactly, to do...
Changing our formulation of AI to avoid runaway risks: Interview with Prof. Stuart Russell
AI is evolving incredibly quickly, and thinking now about where it might go next (and how we as a species and a society should be prepared) is critical. Professor Stuart Russell, an AI expert at UC Berkeley, has a...
Putting machine learning into a database
Most data scientists bounce back and forth regularly between doing analysis in databases using SQL and building and deploying machine learning pipelines in R or python. But if we think ahead a few years, a few visionary...
The work-from-home episode
Many of us have the privilege of working from home right now, in an effort to keep ourselves and our family safe and slow the transmission of covid-19. But working from home is an adjustment for many of us, and can hold...
Understanding Covid-19 transmission: what the data suggests about how the disease spreads
Covid-19 is turning the world upside down right now. One thing that’s extremely important to understand, in order to fight it as effectively as possible, is how the virus spreads and especially how much of the spread of...
Network effects re-release: when the power of a public health measure lies in widespread adoption
This week’s episode is a re-release of a recent episode, which we don’t usually do but it seems important for understanding what we can all do to slow the spread of covid-19. In brief, public health measures for...
Causal inference when you can't experiment: difference-in-differences and synthetic controls
When you need to untangle cause and effect, but you can’t run an experiment, it’s time to get creative. This episode covers difference in differences and synthetic controls, two observational causal inference techniques...
Better know a distribution: the Poisson distribution
This is a re-release of an episode that originally ran on October 21, 2018. The Poisson distribution is a probability distribution function used to for events that happen in time or space. It’s super handy because it’s...
The Lottery Ticket Hypothesis
Recent research into neural networks reveals that sometimes, not all parts of the neural net are equally responsible for the performance of the network overall. Instead, it seems like (in some neural nets, at least)...
Interesting technical issues prompted by GDPR and data privacy concerns
Data privacy is a huge issue right now, after years of consumers and users gaining awareness of just how much of their personal data is out there and how companies are using it. Policies like GDPR are imposing more...
Thinking of data science initiatives as innovation initiatives
Put yourself in the shoes of an executive at a big legacy company for a moment, operating in virtually any market vertical: you’re constantly hearing that data science is revolutionizing the world and the firms that...
Building a curriculum for educating data scientists: Interview with Prof. Xiao-Li Meng
As demand for data scientists grows, and it remains as relevant as ever that practicing data scientists have a solid methodological and technical foundation for their work, higher education institutions are coming to...
Running experiments when there are network effects
Traditional A/B tests assume that whether or not one person got a treatment has no effect on the experiment outcome for another person. But that’s not a safe assumption, especially when there are network effects (like...
Zeroing in on what makes adversarial examples possible
Adversarial examples are really, really weird: pictures of penguins that get classified with high certainty by machine learning algorithms as drumsets, or random noise labeled as pandas, or any one of an infinite number...
Unsupervised Dimensionality Reduction: UMAP vs t-SNE
Dimensionality reduction redux: this episode covers UMAP, an unsupervised algorithm designed to make high-dimensional data easier to visualize, cluster, etc. It’s similar to t-SNE but has some advantages. This episode...
Data scientists: beware of simple metrics
Picking a metric for a problem means defining how you’ll measure success in solving that problem. Which sounds important, because it is, but oftentimes new data scientists only get experience with a few kinds of metrics...
Communicating data science, from academia to industry
For something as multifaceted and ill-defined as data science, communication and sharing best practices across the field can be extremely valuable but also extremely, well, multifaceted and ill-defined. That doesn’t...
Optimizing for the short-term vs. the long-term
When data scientists run experiments, like A/B tests, it’s really easy to plan on a period of a few days to a few weeks for collecting data. The thing is, the change that’s being evaluated might have effects that last a...
Interview with Prof. Andrew Lo, on using data science to inform complex business decisions
This episode features Prof. Andrew Lo, the author of a paper that we discussed recently on Linear Digressions, in which Prof. Lo uses data to predict whether a medicine in the development pipeline will eventually go on...
Using machine learning to predict drug approvals
One of the hottest areas in data science and machine learning right now is healthcare: the size of the healthcare industry, the amount of data it generates, and the myriad improvements possible in the healthcare system...
Facial recognition, society, and the law
Facial recognition being used in everyday life seemed far-off not too long ago. Increasingly, it’s being used and advanced widely and with increasing speed, which means that our technical capabilities are starting to...
Lessons learned from doing data science, at scale, in industry
If you’ve taken a machine learning class, or read up on A/B tests, you likely have a decent grounding in the theoretical pillars of data science. But if you’re in a position to have actually built lots of models or run...
Varsity A/B Testing
When you want to understand if doing something causes something else to happen, like if a change to a website causes and dip or rise in downstream conversions, the gold standard analysis method is to use randomized...
The Care and Feeding of Data Scientists: Growing Careers
In the third and final installment of a conversation with Michelangelo D’Agostino, VP of Data Science and Engineering at Shoprunner, about growing and mentoring data scientists on your team. Some of our topics of...
The Care and Feeding of Data Scientists: Recruiting and Hiring Data Scientists
This week’s episode is the second in a three-part interview series with Michelangelo D’Agostino, VP of Data Science at Shoprunner. This discussion centers on building a team, which means recruiting, interviewing and...
The Care and Feeding of Data Scientists: Becoming a Data Science Manager
Data science management isn’t easy, and many data scientists are finding themselves learning on the job how to manage data science teams as they get promoted into more formal leadership roles. O’Reilly recently release...
Procella: YouTube's super-system for analytics data storage
If you’re trying to manage a project that serves up analytics data for a few very distinct uses, you’d be wise to consider having custom solutions for each use case that are optimized for the needs and constraints of...
Kalman Runners
The Kalman Filter is an algorithm for taking noisy measurements of dynamic systems and using them to get a better idea of the underlying dynamics than you could get from a simple extrapolation. If you've ever run a...
What's *really* so hard about feature engineering?
Feature engineering is ubiquitous but gets surprisingly difficult surprisingly fast. What could be so complicated about just keeping track of what data you have, and how you made it? A lot, as it turns out - most data...
Data storage for analytics: stars and snowflakes
If you’re a data scientist or data engineer thinking about how to store data for analytics uses, one of the early choices you’ll have to make (or live with, if someone else made it) is how to lay out the data in your...
Data storage: transactions vs. analytics
Data scientists and software engineers both work with databases, but they use them for different purposes. So if you’re a data scientist thinking about the best way to store and access data for your analytics, you’ll...
GROVER: an algorithm for making, and detecting, fake news
There are a few things that seem to be very popular in discussions of machine learning algorithms these days. First is the role that algorithms play now, or might play in the future, when it comes to manipulating public...
Data science teams as innovation initiatives
When a big, established company is thinking about their data science strategy, chances are good that whatever they come up with, it’ll be somewhat at odds with the company’s current structure and processes. Which makes...
Posts
No posts yet. Posts Linear Digressions shares on PodSubs, and what it publishes on Substack, YouTube and its own site, will show here.
Subscribe
Be on the front line of the show
Everything Linear Digressions sends its own people, first. Resources, announcements, behind the scenes, events, and giveaways, straight from the host. No account needed.
- The resources the host shares with subscribers
- Announcements before anyone else hears
- Behind the scenes from the team
- Events, invitations, and giveaways
- Only what the host sends, nothing else
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.














