Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Linear Digressions

Linear Digressions artwork

Procella: YouTube's super-system for analytics data storage

Oct 21, 201930 minAudio
ShareXLinkedInFacebookWhatsAppEmail

If you’re trying to manage a project that serves up analytics data for a few very distinct uses, you’d be wise to consider having custom solutions for each use case that are optimized for the needs and constraints of that use cases. You also wouldn’t be YouTube, which found themselves with this problem (gigantic data needs and several very different use cases of what they needed to do with that data) and went a different way: they built one analytics data system to serve them all. Procella, the system they built, is the topic of our episode today: by deconstructing the system, we dig into the four motivating uses of this system, the complexity they had to introduce to service all four uses simultaneously, and the impressive engineering that has to go into building something that “just works.” Relevant links: https://storage.googleapis.com/pub-tools-public-publication-data/pdf/45a6cea2b9c101761ea1b51c961628093ec1d5da.pdf

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. How to Stay Relevant as a Data Scientist in the Age of AI | Interview with Dr. Jon Krohn

    Nov 16, 202644 minAudio

    Staying relevant as a data scientist when AI is reshaping the field isn't just a career question - it's an existential one. Dr. Jon Krohn, neuroscientist-turned-data-science-educator, podcaster, and consultant, sits...

    Credit the people on this episode

  2. GPU Architecture for LLM Inference: Memory, Bandwidth and Hardware Explained

    Nov 9, 202620 minAudio

    GPUs are the engines powering every AI conversation you've ever had - but what's actually happening inside those chips when an LLM generates a response? Understanding GPU fundamentals turns out to be surprisingly useful...

    Credit the people on this episode

  3. KV Cache Fundamentals

    Nov 2, 202624 minAudio

    The unsung hero of every LLM conversation you've ever had? A clever optimization called the KV cache. Self-attention is computationally brutal - every token attending to every other token means costs that scale as N²,...

    Credit the people on this episode

  4. AI Inference 101

    Oct 26, 202628 minAudio

    Everyone talks about training the model - the data, the compute, the alignment magic. But what happens after the weights are frozen and millions of users start hammering it with prompts? That's inference, and it's a...

    Credit the people on this episode

  5. Back Next Week

    Oct 19, 202618 secAudio

    Back Next Week by Katie Malone

    Credit the people on this episode