Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Embedded AI - Intelligence at the Deep Edge

Embedded AI - Intelligence at the Deep Edge artwork

Most Neurons Do Nothing and That's the Point!

Feb 25, 202618 minAudio
ShareXLinkedInFacebookWhatsAppEmail

Send us Fan Mail This episode explores why biological neural networks are inherently sparse, with only 1 to 5 percent of cortical neurons active at any moment, and why this silence is a feature rather than a limitation. We trace the evolutionary pressures that drove the brain toward sparse coding, from the metabolic cost of each spike to the fixed energy budget per neuron, and examine the computational advantages that follow: greater memory capacity, more efficient representations, and robust generalisation. The discussion then turns to what this means for artificial intelligence, covering the Lottery Ticket Hypothesis, dynamic sparse training, Mixture of Experts architectures, and spiking neural networks. For engineers building at the deep edge, the conclusion is clear: strategic sparsity is not a constraint to work around but a design principle to build on. Support the show If you are interested in learning more then please subscribe to the podcast or head over to https://medium.com/@reefwing, where there is lots more content on AI, IoT, robotics, drones, and development. To support us in bringing you this material, you can buy me a coffee or just provide feedback. We love feedback!

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. AI Exposes Unpatchable Smart Devices

    Nov 18, 202619 minAudio

    Send us Fan Mail What happens when vulnerability discovery scales with compute, but remediation remains trapped in the physical supply chain? In this episode, we dive into a landmark study from Forescout’s Vedere Labs,...

    Credit the people on this episode

  2. Are LLMs Creating Languages to Speak with Each Other?

    Nov 8, 202625 minAudio

    Send us Fan Mail Is AI developing a secret, unreadable language beyond human comprehension? In this episode, we unpack the origins, popular myths, and technical realities surrounding "neuralese" - the continuous vector...

    Credit the people on this episode

  3. Why AI Learns Consensus Over Truth

    Nov 6, 202621 minAudio

    Send us Fan Mail In this episode we explore why frontier large language models frequently prioritize popular consensus and plausible-sounding explanations over objective truth. Built primarily on massive web crawls -...

    Credit the people on this episode

  4. Why AI Models Keep Inventing Religions

    Oct 22, 202625 minAudio

    Send us Fan Mail The only AI religion (so far) that filed with the US tax office is Way of the Future, Anthony Levandowski’s church of the coming superintelligence. Its entire audited history is one deposit of...

    Credit the people on this episode

  5. The Future of AI Interfaces

    Oct 15, 202622 minAudio

    Send us Fan Mail What comes after the chatbot? As Codex and Claude evolve into tools that can research, create, and act across applications, the interface becomes as important as the intelligence behind it. In this...

    Credit the people on this episode