Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Into the Impossible With Brian Keating

Into the Impossible With Brian Keating artwork

Roman Yampolskiy vs Emad Mostaque: I Was The Only Optimist - #569

Sep 1, 202658 minAudio
ShareXLinkedInFacebookWhatsAppEmail

The man who open-sourced the most-used AI image model in history sat down with the man who has spent a decade proving superintelligence cannot be controlled. Brian set up a debate. What emerged was something more unsettling than any debate. Roman Yampolskiy is the computer scientist who coined the term AI safety and author of AI: Unexplainable, Unpredictable, Uncontrollable. Emad Mostaque is the co-founder of Stable Diffusion and the only AI CEO who signed the pause letter. He now says he doesn’t know how a pause could work. Yampolskiy thinks that is the only option left. The question underneath everything is simple: if you have a 50% chance of wiping out civilization and you build it anyway, what are you actually doing? We cover what AI safety researchers actually think the danger is, why nobody has published a paper, filed a patent, or shipped a prototype for controlling a superintelligence, what the Qwen weights being out means for the pause argument, and why Mostaque thinks swarm intelligence is the most dangerous and most unpredictable risk vector we have. What you’ll hear: -Why both guests think P(doom) tells you less than you’d hope -What it means that no company, no lab, and no team has a patent on controlling superintelligence -Why the models the public receives are slightly lobotomized -The difference between an AI swarm and the ASI everyone is debating -Why giving every psychopath access to a cutting-edge intelligence weapon is incoherent safety strategy -What it would actually take to update Yampolskiy’s assessment “We either do it, or we die. There is nothing for you to gain by doing it.” - Roman Yampolskiy CHAPTERS 00:00 A debate that wasn't a debate 00:36 Turing test, AGI, superintelligence: where are we? 02:02 The open source argument nobody wins 03:32 Pause frontier AI forever. Which button? 05:04 P(doom): parameterizing our ignorance 09:02 Nukes are inefficient. AI isn't. 11:46 The lobotomized model problem 18:04 Decade-old problems solved weekly now 26:18 We either do it or we die 31:10 Stop the training or stop the funders 33:34 Lipstick on a Shoggoth 35:50 No paper. No patent. No framework. 39:42 Train only on what you need 44:14 What lowers Mostaque's p(doom)? 52:00 Same future. Two perspectives. Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/yt Have a .edu email and live in the USA? You automatically win a meteorite: https://BrianKeating.com/edu Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1 Support Into the Impossible on Patreon, get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join Featured Guests: Roman Yampolskiy on Twitter/X: https://x.com/romanyam?lang=en AI: Unexplainable, Unpredictable, Uncontrollable (book): https://www.amazon.com/dp/103257626X MIRI: https://intelligence.org Emad Mostaque on Twitter/X: https://x.com/EMostaque I.I.I. Inc.: https://ii.inc/ Stable Diffusion: https://stability.ai/ My books: Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U Galileo’s Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un Twitter/X: https://x.com/BrianKeating Substack: https://briankeating.substack.com Blog: https://briankeating.com/blog Audio-only: https://briankeating.com/podcast #AIrisk #aisafety #stablediffusion #RomanYampolskiy #EmadMostaque #briankeating #intotheimpossible

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Sabine Hossenfelder: The TRUTH About AI Doom!

    Nov 20, 20261 hr 13 minAudio

    A theoretical physicist claims particle physicists have wasted decades searching for dark matter particles with zero evidence. The real path to the next physics breakthrough requires a total pivot that mainstream...

    Credit the people on this episode

  2. Fields Medalist: AI Can Do Every Basic PhD Problem in Days

    Nov 19, 20261 hr 6 minAudio

    A Fields Medalist says AI can now do every basic PhD problem in hours or days. The question is no longer whether machines can prove theorems. It is who will still understand them. Alessio Figalli won the 2018 Fields...

    Credit the people on this episode

  3. Physics Professor: How Much Power Does a UFO Really Need?

    Nov 11, 202645 minAudio

    Most UAP probably aren’t alien spacecraft. A physics professor says so himself, and in these slides one UFO photo turns out to be a seagull while a colleague’s analysis of crash debris found more Earth dirt than he...

    Credit the people on this episode

  4. Princeton Mathematician: Wormholes Can’t Survive Einstein’s Math

    Nov 3, 202656 minAudio

    A Princeton mathematician says wormholes cannot survive Einstein's equations, and the AI apocalypse is absurd. A solution that vanishes under a small nudge is a ghost, not physics. Sergiu Klainerman is a mathematician...

    Credit the people on this episode

  5. Are We in a SIMULATION? | Brian Keating on the Arora Podcast

    Nov 1, 20261 hr 55 minAudio

    The Arora Show with Brian Keating What happens when science reaches the edge of what it can explain? In this episode of The Arora Show, Amira & Aryaan sit down with renowned cosmologist and physicist Professor Brian...

    Credit the people on this episode