Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

TechSurge: Deep Tech Podcast

TechSurge: Deep Tech Podcast artwork

The Race to Build the Next Trillion-Dollar AI Chip Company

Sep 16, 20261 hr 12 minAudio

Almost 2% of U.S. GDP will be spent on AI infrastructure this year, nearly double 2025's figure. But beneath those headline numbers, the composition of that spending has quietly flipped: for the first time, dollars spent on running models in production now outweigh dollars spent training them. In this episode of TechSurge, host David Goldman speaks with Austin Lyons, a semiconductor analyst at Creative Strategies, co-host of the Semi Doped podcast, and author of the Chipstrat newsletter. Lyons previously worked as a hardware engineer at Intel and as a product manager on John Deere's autonomous tractor and Blue River Technology teams before turning to full-time chip industry analysis. The conversation opens with why AI buyers have moved from assembling commoditized parts to buying entire pre-integrated systems, tracing how Nvidia's rack-scale approach, exemplified by its 72-GPU Grace Blackwell racks, made turnkey deployment the default, and why that raises the bar for any chip startup trying to compete. Lyons and Goldman then unpack how inference workloads have split into two distinct problems, prefill and decode, and how that split created an opening for SRAM-based challengers to outperform general-purpose GPUs on decode speed. From there, the discussion turns to the rise of neoclouds, the GPU-rental companies that grew into public businesses worth well over $100 billion combined, and why so many traditional investors missed them. Lyons and Goldman work through the circular financing debate head-on: the mechanics of Nvidia's equity stakes, GPU-backed debt, and hyperscaler off-take agreements that critics compare to dot-com-era vendor financing, and the counterargument that demand is simply outrunning fixed supply. The episode closes on Lyons's own framework for identifying the next trillion-dollar chip company, built on four conditions including the ability to run trillion-parameter models at rack scale, beat an incumbent on a key performance metric, and land a frontier anchor customer, along with a look at how AI-assisted chip design is lowering the barrier for more companies, from OpenAI to electric vehicle makers, to design their own custom silicon. Sign up for our newsletter at techsurgepodcast.com for updates on upcoming TechSurge Live Summits and future episodes. Speaker Profiles and Links David Goldman: Partner, Celesta Capital Austin Lyons: Senior Analyst, Creative Strategies; Founder, Chipstrat; Co-host, Semi Doped LinkedIn: https://www.linkedin.com/in/austinlyons/ Newsletter: https://www.chipstrat.com Further Reading and Resources Nvidia DGX GB Rack Scale Systems documentation: https://docs.nvidia.com/dgx/dgxgb200-user-guide/ OpenAI and Broadcom - "OpenAI and Broadcom Unveil LLM-Optimized Inference Chip": https://openai.com/index/openai-broadcom-jalapeno-inference-chip/ Chipstrat - Austin Lyons's newsletter: https://www.chipstrat.com Semi-doped: https://semidoped.com/ Timestamps 00:00 - No One's Brought a Chip to Market Built for LLMs 01:21 - Introducing Austin Lyons 02:16 - Why AI Buyers Now Buy Whole Systems, Not Parts 08:18 - Nvidia's Margins and the Case for System Simplicity 10:10 - Can a Startup Compete When You Have to Sell Systems? 14:12 - Prefill vs. Decode: Splitting the Inference Workload 24:51 - Fragmentation vs. Consolidation in AI Silicon 28:22 - Why Investors Missed the First Wave of Neoclouds 38:18 - The Circular Financing Debate 48:29 - Lyons's Four Conditions for the Next Trillion-Dollar Chip Company About TechSurge: TechSurge Podcast shares the latest insights directly from legendary Silicon Valley leaders, daring new founders, and visionary technologists. Subscribe for weekly conversations into the intersection of technology advancement, market dynamics, and founder journeys. #AISilicon #LLMHardware #Nvidia #AIInference #TechPodcasts #AIInfrastructure

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. From Chips to Agents: Rebuilding the AI Stack

    Nov 18, 20261 hr 1 minAudio

    By May, Google alone was processing more than 3.2 quadrillion tokens a month, seven times what it processed a year earlier. Keeping pace with that demand means rebuilding the entire technology stack, from compute and...

    Credit the people on this episode

  2. FedEx CEO on AI and the Two Trillion Dollar Supply Chain Problem

    Nov 3, 202641 minAudio

    Before 2020, few people thought about supply chains. The pandemic put them on every boardroom agenda, and trade and geopolitics now make them critical issues for every global company. Few businesses have a better view...

    Credit the people on this episode

  3. Are LLMs a Dead End? The Case for AI That Learns From Experience

    Oct 21, 202658 minAudio

    In this episode, Dr. Patrick Pilarski, co-author of the Alberta Plan alongside Richard Sutton and Michael Bowling, makes the case for a radically different kind of AI: one that never stops learning, builds its own...

    Credit the people on this episode

  4. Gaming Chip Pioneer Raja Koduri on China's AI Cost Advantage and Moving Beyond the GPU

    Sep 29, 20261 hr 1 minAudio

    In this episode, host David Goldman speaks with legendary graphics chip architect Raja Koduri, who explains why every gigawatt of AI infrastructure now costs $50 to $60 billion, and why China's goal of doing it for...

    Credit the people on this episode

  5. The Nobel Winner Behind Google's Quantum AI Lab: Why I'm Building the NVIDIA of Quantum

    Sep 1, 20261 hr 9 minAudio

    In this episode, Nobel Prize-winning physicist Dr. John Martinis reveals how his breakthrough in superconducting qubits made quantum physics real at macroscopic scale and what it means for the future of technology. The...

    Credit the people on this episode