Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Embedded AI - Intelligence at the Deep Edge

Embedded AI - Intelligence at the Deep Edge artwork

Large Language Monkeys: Why Noise Yields No Knowledge

Aug 28, 202623 minAudio
ShareXLinkedInFacebookWhatsAppEmail

Send us Fan Mail There is an old claim that a truly random source contains all knowledge: give monkeys enough time at typewriters and Shakespeare falls out. In 2024 two Sydney mathematicians did the arithmetic and found the universe ends first. But the idea has a modern tail. We now have language models that can spot meaningful text instantly, so why not let randomness generate and an LLM extract? This episode works through why that fails, and why the failure is precise: in a random stream, the address of any text costs as many bits as the text itself. Along the way: Borges' Library of Babel, a website that actually built it, DeepMind systems that made the generate-and-filter idea work by cheating in exactly the right way, and what your brain does with noise that an LLM cannot. Support the show If you are interested in learning more then please subscribe to the podcast or head over to https://medium.com/@reefwing, where there is lots more content on AI, IoT, robotics, drones, and development. To support us in bringing you this material, you can buy me a coffee or just provide feedback. We love feedback!

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. AI Exposes Unpatchable Smart Devices

    Nov 18, 202619 minAudio

    Send us Fan Mail What happens when vulnerability discovery scales with compute, but remediation remains trapped in the physical supply chain? In this episode, we dive into a landmark study from Forescout’s Vedere Labs,...

    Credit the people on this episode

  2. Are LLMs Creating Languages to Speak with Each Other?

    Nov 8, 202625 minAudio

    Send us Fan Mail Is AI developing a secret, unreadable language beyond human comprehension? In this episode, we unpack the origins, popular myths, and technical realities surrounding "neuralese" - the continuous vector...

    Credit the people on this episode

  3. Why AI Learns Consensus Over Truth

    Nov 6, 202621 minAudio

    Send us Fan Mail In this episode we explore why frontier large language models frequently prioritize popular consensus and plausible-sounding explanations over objective truth. Built primarily on massive web crawls -...

    Credit the people on this episode

  4. Why AI Models Keep Inventing Religions

    Oct 22, 202625 minAudio

    Send us Fan Mail The only AI religion (so far) that filed with the US tax office is Way of the Future, Anthony Levandowski’s church of the coming superintelligence. Its entire audited history is one deposit of...

    Credit the people on this episode

  5. The Future of AI Interfaces

    Oct 15, 202622 minAudio

    Send us Fan Mail What comes after the chatbot? As Codex and Claude evolve into tools that can research, create, and act across applications, the interface becomes as important as the intelligence behind it. In this...

    Credit the people on this episode