Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Into the Impossible With Brian Keating

Into the Impossible With Brian Keating artwork

Robert Wright: AI Alignment Is a Moral Problem, Not a Technical One

Sep 30, 20261 hrAudio
ShareXLinkedInFacebookWhatsAppEmail

The real AI alignment problem is not technical. It is moral. You cannot align a superintelligence to human values if humans cannot agree on what those values are, and you cannot get that agreement without a level of global cooperation we have never managed before. Subscribe if you want science with evidence, not speculation. The Tower of Babel is the AI parable nobody is reading. Technology that outpaces wisdom fragments the people building it. The Fermi paradox offers the grimmer version: civilizations that reach the capacity to blow themselves up typically do. Robert Wright has been watching this longer than almost anyone, he was reporting on neural networks in 1983, and his conclusion is not that the machines will fail the test. It is that we will. Wright’s book argues that superintelligence is not the danger and AI alignment is not the solution unless it comes with a moral advance. Passing the God test requires something no lab can ship. What you’ll hear: -Why Wright thinks p(doom) fails as a scientific concept -What the binding of Isaac and the Tower of Babel have in common as moral tests -Why global cooperation is the only thing that can actually slow AI down -What Lee Smolin’s cosmological natural selection has to do with the Fermi paradox -What Wright thinks Eastern and Western enlightenment have in common and why it matters now -Whether there is a role for humanity inside the global brain or only for the machines “We face the kind of test that God would give.” - Robert Wright CHAPTERS 00:00 The man who interviewed Hinton in 1983 05:04 The God test and its two meanings 08:36 Religious faith in technological progress 14:10 Hinton then versus Hinton now 19:38 Why slowing AI down requires international cooperation 26:02 How LLMs reverse-engineer the meaning of words 32:08 Brian's Einstein test: can Claude have a happy thought? 40:06 AGI is impossible. Here is why Brian thinks that. 47:04 The Fermi paradox as a moral filter 51:10 What passing the God test actually looks like Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/yt Have a .edu email and live in the USA? You automatically win a meteorite: https://BrianKeating.com/edu Enter the debate: briankeating.com/ai Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1 Support Into the Impossible on Patreon, get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join Featured Guest: The God Test (book): https://thegodtest.net Robert Wright on Twitter/X: https://x.com/RWrighter My books: Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U Galileo’s Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un Twitter/X: https://x.com/BrianKeating Substack: https://briankeating.substack.com Blog: https://briankeating.com/blog Audio-only: https://briankeating.com/podcast #RobertWright #AIalignment #superintelligence #FermiParadox #briankeating #intotheimpossible #AI

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Sabine Hossenfelder: The TRUTH About AI Doom!

    Nov 20, 20261 hr 13 minAudio

    A theoretical physicist claims particle physicists have wasted decades searching for dark matter particles with zero evidence. The real path to the next physics breakthrough requires a total pivot that mainstream...

    Credit the people on this episode

  2. Fields Medalist: AI Can Do Every Basic PhD Problem in Days

    Nov 19, 20261 hr 6 minAudio

    A Fields Medalist says AI can now do every basic PhD problem in hours or days. The question is no longer whether machines can prove theorems. It is who will still understand them. Alessio Figalli won the 2018 Fields...

    Credit the people on this episode

  3. Physics Professor: How Much Power Does a UFO Really Need?

    Nov 11, 202645 minAudio

    Most UAP probably aren’t alien spacecraft. A physics professor says so himself, and in these slides one UFO photo turns out to be a seagull while a colleague’s analysis of crash debris found more Earth dirt than he...

    Credit the people on this episode

  4. Princeton Mathematician: Wormholes Can’t Survive Einstein’s Math

    Nov 3, 202656 minAudio

    A Princeton mathematician says wormholes cannot survive Einstein's equations, and the AI apocalypse is absurd. A solution that vanishes under a small nudge is a ghost, not physics. Sergiu Klainerman is a mathematician...

    Credit the people on this episode

  5. Are We in a SIMULATION? | Brian Keating on the Arora Podcast

    Nov 1, 20261 hr 55 minAudio

    The Arora Show with Brian Keating What happens when science reaches the edge of what it can explain? In this episode of The Arora Show, Amira & Aryaan sit down with renowned cosmologist and physicist Professor Brian...

    Credit the people on this episode