Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Linear Digressions

Linear Digressions artwork

Data scientists: beware of simple metrics

Jan 5, 202025 minAudio

Picking a metric for a problem means defining how you’ll measure success in solving that problem. Which sounds important, because it is, but oftentimes new data scientists only get experience with a few kinds of metrics when they’re learning and those metrics have real shortcomings when you think about what they tell you, or don’t, about how well you’re really solving the underlying problem. This episode takes a step back and says, what are some metrics that are popular with data scientists, why are they popular, and what are their shortcomings when it comes to the real world? There’s been a lot of great thinking and writing recently on this topic, and we cover a lot of that discussion along with some perspective of our own. Relevant links: https://www.fast.ai/2019/09/24/metrics/ https://arxiv.org/abs/1909.12475 https://medium.com/shoprunner/evaluating-classification-models-1-ff0730801f17 https://hbr.org/2019/09/dont-let-metrics-undermine-your-business

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. How to Stay Relevant as a Data Scientist in the Age of AI | Interview with Dr. Jon Krohn

    Nov 16, 202644 minAudio

    Staying relevant as a data scientist when AI is reshaping the field isn't just a career question - it's an existential one. Dr. Jon Krohn, neuroscientist-turned-data-science-educator, podcaster, and consultant, sits...

    Credit the people on this episode

  2. GPU Architecture for LLM Inference: Memory, Bandwidth and Hardware Explained

    Nov 9, 202620 minAudio

    GPUs are the engines powering every AI conversation you've ever had - but what's actually happening inside those chips when an LLM generates a response? Understanding GPU fundamentals turns out to be surprisingly useful...

    Credit the people on this episode

  3. KV Cache Fundamentals

    Nov 2, 202624 minAudio

    The unsung hero of every LLM conversation you've ever had? A clever optimization called the KV cache. Self-attention is computationally brutal - every token attending to every other token means costs that scale as N²,...

    Credit the people on this episode

  4. AI Inference 101

    Oct 26, 202628 minAudio

    Everyone talks about training the model - the data, the compute, the alignment magic. But what happens after the weights are frozen and millions of users start hammering it with prompts? That's inference, and it's a...

    Credit the people on this episode

  5. Back Next Week

    Oct 19, 202618 secAudio

    Back Next Week by Katie Malone

    Credit the people on this episode