Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

TechSurge: Deep Tech Podcast

TechSurge: Deep Tech Podcast artwork

Governing AI Before It Outpaces Us: Safety for Critical Infrastructure

Mar 5, 202658 minAudio
ShareXLinkedInFacebookWhatsAppEmail

As generative AI systems move from novelty to infrastructure, questions of safety, trust, and governance are becoming urgent. In this episode of TechSurge, host Sriram Viswanathan is joined by Dr. Rumman Chowdhury, CEO of Humane Intelligence PBC and responsible AI Pioneer, about what AI safety really means and why the industry may be focusing on the wrong problems. Rumman argues that the most overlooked lever in AI development is evaluation. While companies emphasize model training and capabilities, far less attention is paid to how systems are assessed in real-world contexts, who defines “good,” what risks are measured, and how societal impacts are accounted for at scale. She distinguishes between technical assurance and broader sociotechnical risk, from misinformation and bias to over-reliance and erosion of institutional trust. Drawing on her experience at Twitter (X) and in global policy circles, Rumman highlights a fundamental governance gap: unlike finance, aviation, or healthcare, AI lacks a mature, independent ecosystem of auditors and evaluators. Today, the same companies building AI systems often define what counts as harm. She also challenges the belief that stronger guardrails alone will solve the problem, noting that cultural context, language differences, and human behavior complicate any notion of “neutral” or fully objective AI. Rather than focusing solely on speculative existential threats, Rumman urges attention to the harms already visible from AI-enabled misinformation to mental health risks and shifts in how younger generations relate to knowledge and authority. The future of AI, she suggests, will be determined not just by technological breakthroughs, but by whether we build credible systems of accountability, evaluation, and global cooperation around them. If you enjoy this episode, please subscribe and leave us a review on your favorite podcast platform. Sign up for our newsletter at techsurgepodcast.com for updates on upcoming TechSurge Live Summits and future Season 2 episodes. Episode Links Connect with Rumman: https://www.linkedin.com/in/rumman Learn more about Humane Intelligence: https://humane-intelligence.org/ Timestamps 02:50 Why AI Evaluations Matter: Defining “Good” Models in Context 04:25 What Is AI Safety? From Product Performance to Societal Harm 11:30 Regulation Reality Check: EU AI Act, Conformance Assessments & Checklists 15:25 Building the AI Evaluation Profession: Audits, Red Teaming & Legal Protections 23:00 When It’s OK to Outsource Judgment and When It’s Dangerous 39:38Who’s Responsible When AI Outcomes Go Wrong? 52:37 Design vs Governance: Complex Systems, System-Level Evaluation, and Regulating Horizontally 44:11 AI Psychosis, Youth Harm, and What’s Already Here 47:27 What Keeps Rumman Up at Night: Kids, Algorithms, and Hope from Global Governance 54:00 Bringing Sci-Fi to the Real World?

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. From Chips to Agents: Rebuilding the AI Stack

    Nov 18, 20261 hr 1 minAudio

    By May, Google alone was processing more than 3.2 quadrillion tokens a month, seven times what it processed a year earlier. Keeping pace with that demand means rebuilding the entire technology stack, from compute and...

    Credit the people on this episode

  2. FedEx CEO on AI and the Two Trillion Dollar Supply Chain Problem

    Nov 3, 202641 minAudio

    Before 2020, few people thought about supply chains. The pandemic put them on every boardroom agenda, and trade and geopolitics now make them critical issues for every global company. Few businesses have a better view...

    Credit the people on this episode

  3. Are LLMs a Dead End? The Case for AI That Learns From Experience

    Oct 21, 202658 minAudio

    In this episode, Dr. Patrick Pilarski, co-author of the Alberta Plan alongside Richard Sutton and Michael Bowling, makes the case for a radically different kind of AI: one that never stops learning, builds its own...

    Credit the people on this episode

  4. Gaming Chip Pioneer Raja Koduri on China's AI Cost Advantage and Moving Beyond the GPU

    Sep 29, 20261 hr 1 minAudio

    In this episode, host David Goldman speaks with legendary graphics chip architect Raja Koduri, who explains why every gigawatt of AI infrastructure now costs $50 to $60 billion, and why China's goal of doing it for...

    Credit the people on this episode

  5. The Race to Build the Next Trillion-Dollar AI Chip Company

    Sep 16, 20261 hr 12 minAudio

    Almost 2% of U.S. GDP will be spent on AI infrastructure this year, nearly double 2025's figure. But beneath those headline numbers, the composition of that spending has quietly flipped: for the first time, dollars...

    Credit the people on this episode