Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Super Data Science: ML & AI Podcast with Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn artwork

977: Attention, World Models and the Future of AI, with Prof. Kyunghyun Cho

Mar 24, 20261 hr 18 minAudio
ShareXLinkedInFacebookWhatsAppEmail

What’s going to be the next big step function that blasts us forward in AI capabilities? To find out, Jon Krohn sits down with Professor Kyunghyun Cho, whose 200,000 citations and co-authorship of the first paper on attention place him among the most influential AI researchers in the world. In this episode, Kyunghyun explains why today’s models have already captured most correlations in passive data, making the real challenge about actively choosing which data to collect. He also weighs in on the open debate around world models, whether AI needs high-fidelity, step-by-step imagination or whether a high-level latent representation that lets it skip ahead is sufficient and shares the surprising discovery that 80% of his 200 computer science students had never installed a coding agent. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/977⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (06:43) The story behind the attention mechanism (28:43) Sample efficiency and active data collection (39:04) World models and latent planning (49:52) Teaching undergrads with coding agents (58:21) Reranking, multi-stage ranking, and the foundations of RAG

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. 1046: Weighing a Feather: How to Design A/B Tests That Work, with Billur Engin

    Nov 20, 202625 minAudio

    In Episode #1046, Billur Engin (who leads data science and analytics at Prolific) joins Jon Krohn to explain how to design experiments that actually teach you something. Too many A/B tests, she says, are like bathroom...

    Credit the people on this episode

  2. 1045: How AI Chips Are Built, with Benjamin Hein

    Nov 17, 202656 minAudio

    In Episode #1045, Ben Hein (CEO of the Electronics business at Merck KGaA, Darmstadt, Germany) joins Jon Krohn to explain how the chips behind the AI boom are actually made. His company is 358 years old, began as a...

    Credit the people on this episode

  3. 1044: In Case You Missed It in October 2026

    Nov 13, 202632 minAudio

    In this month's episode of ICYMI, Jon Krohn moves from the fears that surround AI to the work it makes possible when we use it well. Hear from Richard Socher, Carly Taylor, Jeff Hancock, Kate Niederhoffer and John...

    Credit the people on this episode

  4. 1043: AI-Powered Precision Nutrition, with Viome’s Dr. Guru Banavar

    Nov 10, 20261 hr 13 minAudio

    In Episode #1043, Dr. Guru Banavar (Founding CTO of Viome) joins Jon Krohn for a technical masterclass on the biology inside your gut. Viome has assembled what Guru calls the largest dataset on human biology ever...

    Credit the people on this episode

  5. 1042: Building for the Agent-Native App Store, with Salesforce’s Tyler Carlson

    Nov 6, 202637 minAudio

    #Sponsored, SVP, Head of Product, AgentExchange and Partner Experience, Tyler Carlson, returns to talk to Jon Krohn about building for an agent-native app store. Since Tyler’s last appearance in Episode 956, Salesforce...

    Credit the people on this episode