Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Into the Impossible With Brian Keating

Into the Impossible With Brian Keating artwork

The Mysterious Math Behind LLMs - Anil Ananthaswamy - #537

Jan 23, 20261 hr 11 minAudio
ShareXLinkedInFacebookWhatsAppEmail

WANTED: Developers and STEM experts! Get paid to create benchmarks and improve AI models. Sign up for Alignerr using our link: https://alignerr.com/?referral-source=briankeating One of the most powerful AI systems we’ve ever built is succeeding for reasons we still don’t understand. And worse, they may succeed for reasons that might lock us into the wrong future for humanity. Today’s guest is Anil Ananthaswamy, an award-winning science writer and one of the clearest thinkers on the mathematical foundations of machine learning. In this conversation, we’re not just talking about new demos, incremental improvements, or updates on new models being released. We’re asking even harder questions: Why does the mathematics of machine learning work at all? How do these models succeed when they suffer from problems like overparameterization and lack of training data? And are large language models revealing deep structure, or are they just producing very convincing illusions and causing us to face an increasingly AI-slop-driven future? KEY TAKEAWAYS 00:00 - Book explores why ML works through math 02:47 - Perceptron proof shows simple math guarantees learning 05:11 - Early AI failed due to single-layer limits 07:12 - Nonlinear limits caused the first AI winter 09:04 - Backpropagation revived neural networks 10:59 - GPUs + big data enabled deep learning 15:25 - AI success risks technological lock-in 17:30 - LLMs lack human-like learning and embodiment 22:57 - High-dimensional spaces power ML behavior 27:36 - Data saturation may slow future gains 31:11 - Continual learning is still missing in AI 33:46 - Neuromorphic chips promise energy efficiency 41:49 - Overparameterized models still generalize well 45:05 - SGD succeeds via randomness in complex landscapes 48:27 - Perceptrons remain the core of modern neural net - Additional resources: Anil's NEW Book "Why Machines Learn: The Elegant Math Behind Modern AI": https://www.amazon.com/Why-Machines-Learn-Elegant-Behind/dp/0593185749 Get My NEW Book: Focus Like a Nobel Prize Winner: https://www.amazon.com/dp/B0FN8DH6SX?ref_=pe_93986420_775043100 Please join my mailing list here 👉 https://briankeating.com/yt to win a meteorite 💥 - Join this channel to get access to perks like monthly Office Hours: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join 📚 Get a copy of my books: Think Like a Nobel Prize Winner, with life changing interviews with 9 Nobel Prizewinners: https://a.co/d/03ezQFu My tell-all cosmic memoir Losing the Nobel Prize: http://amzn.to/2sa5UpA The first-ever audiobook from Galileo: Dialogue Concerning the Two Chief World Systems: Ptolemaic and Copernican https://a.co/d/iZPi9Un 📺 Watch my most popular videos:📺 Neil Turok https://www.youtube.com/watch?v=Dt5cFLN65fI Frank Wilczek https://youtu.be/3z8RqKMQHe0?sub_confirmation=1 Eric Weinstein vs. Stephen Wolfram https://www.youtube.com/watch?v=OI0AZ4Y4Ip4?sub_confirmation=1 Sir Roger Penrose: https://youtu.be/AMuqyAvX7Wo Sabine Hossenfelder: https://youtu.be/g00ilS6tBvs Avi Loeb: https://youtu.be/N9lUceHsLRw Follow me to ask questions of my guests: 🏄‍♂️ Twitter: https://twitter.com/DrBrianKeating 🔔 Subscribe https://www.youtube.com/DrBrianKeating?sub_confirmation=1 📝 Join my mailing list; just click here http://briankeating.com/list ✍️ Detailed Blog posts here: https://briankeating.com/blog 🎙️ Listen on audio-only platforms: https://briankeating.com/podcast #universe #podcast #briankeating #intotheimpossible #science #astronomy #cosmology #cosmicmicrowavebackground #intotheimpossible #briankeating #AnilAnanthaswamy

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Sabine Hossenfelder: The TRUTH About AI Doom!

    Nov 20, 20261 hr 13 minAudio

    A theoretical physicist claims particle physicists have wasted decades searching for dark matter particles with zero evidence. The real path to the next physics breakthrough requires a total pivot that mainstream...

    Credit the people on this episode

  2. Fields Medalist: AI Can Do Every Basic PhD Problem in Days

    Nov 19, 20261 hr 6 minAudio

    A Fields Medalist says AI can now do every basic PhD problem in hours or days. The question is no longer whether machines can prove theorems. It is who will still understand them. Alessio Figalli won the 2018 Fields...

    Credit the people on this episode

  3. Physics Professor: How Much Power Does a UFO Really Need?

    Nov 11, 202645 minAudio

    Most UAP probably aren’t alien spacecraft. A physics professor says so himself, and in these slides one UFO photo turns out to be a seagull while a colleague’s analysis of crash debris found more Earth dirt than he...

    Credit the people on this episode

  4. Princeton Mathematician: Wormholes Can’t Survive Einstein’s Math

    Nov 3, 202656 minAudio

    A Princeton mathematician says wormholes cannot survive Einstein's equations, and the AI apocalypse is absurd. A solution that vanishes under a small nudge is a ghost, not physics. Sergiu Klainerman is a mathematician...

    Credit the people on this episode

  5. Are We in a SIMULATION? | Brian Keating on the Arora Podcast

    Nov 1, 20261 hr 55 minAudio

    The Arora Show with Brian Keating What happens when science reaches the edge of what it can explain? In this episode of The Arora Show, Amira & Aryaan sit down with renowned cosmologist and physicist Professor Brian...

    Credit the people on this episode