Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

NEXT with John Koetsier

NEXT with John Koetsier artwork

SLMs vs LLMs: 10% of the cost, 100% of the accuracy?

Feb 10, 202618 minAudio
ShareXLinkedInFacebookWhatsAppEmail

Large language models have dominated the AI conversation - but are small language models (SLMs) actually the future? In this episode of TechFirst, host John Koetsier sits down with Andy Markus, SVP & Chief Data and AI Officer at AT&T, to unpack how small language models are delivering enterprise-grade accuracy at a fraction of the cost and latency of massive LLMs. Andy explains how AT&T uses SLMs for: • Contract analysis at massive scale • Network analytics and outage root-cause analysis • Fraud detection and enterprise knowledge systems • AI-driven “field coding” and agent-based workflows They also dive into the rise of agentic AI, how structured “archetypes” replace risky vibe coding, and why the future of software development may be humans supervising autonomous AI systems rather than writing every line of code. If you’re building AI for real-world, high-scale use cases - especially in enterprise environments - this conversation is essential. ⸻ Guest Andy Markus SVP & Chief Data and AI Officer, AT&T Former SVP at Time Warner Media ⸻ 👉 Subscribe for more deep dives on AI, technology, and the future of innovation: https://techfirst.substack.com ⸻ 00:00 - Why the future of AI might be small 00:55 - What is a small language model (SLM)? 01:45 - From LLM hype to enterprise reality 02:25 - Solving accuracy, cost, and latency at once 03:05 - How small is “small”? Parameters explained 03:55 - Where SLMs work best inside enterprises 04:45 - Contract analysis and enterprise vector stores 05:35 - Network analytics and outage root-cause analysis 06:45 - AI as a super-charged network engineer 07:35 - Choosing high-ROI AI use cases 08:20 - 4× ROI: measuring real business impact 09:00 - AI field coding vs risky vibe coding 10:10 - Archetypes, super agents, and structured AI workflows 11:15 - What software engineers still need to do 12:10 - From punch cards to natural language programming 13:10 - Human-in-the-loop vs autonomous AI agents 14:10 - How small can models really get? 15:10 - Responsible AI at enterprise scale 16:00 - The future of agentic AI and autonomy 17:10 - Why AI output is finally becoming predictable 18:10 - Final thoughts on where AI is headed

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. AI is breaking the app economy

    Nov 20, 202634 minAudio

    AI is changing everything about apps, including something most developers don't think enough about: how to actually make money.In traditional software, your most engaged users were often your most valuable. With AI,...

    Credit the people on this episode

  2. Everything's breaking, and it's AI's fault

    Nov 18, 202616 minAudio

    Why are banks, major websites, cloud services, and critical infrastructure suddenly experiencing so many outages? Is it a coordinated cyberattack? AI-powered hackers? Or something else entirely?Josh Koenig, co-founder...

    Credit the people on this episode

  3. 100,000 robotaxi rides from the company you've never heard of

    Nov 4, 202618 minAudio

    Waymo and Tesla get the headlines. But Avride has quietly completed more than 100,000 commercial autonomous rides through Uber in Dallas, driven over 2 million autonomous miles, and built a fleet of more than 200...

    Credit the people on this episode

  4. Biggest robot security deal ever?

    Oct 22, 202614 minAudio

    Robot guard dogs are moving from experiments to serious business. Asylon Robotics has signed a $17 million, five-year deal with security giant Securitas to deploy autonomous robot dogs and aerial drones at critical...

    Credit the people on this episode

  5. 1,000 humanoid robots. 1 factory.

    Oct 5, 202628 minAudio

    What does it actually take to put 1,000 humanoid robots to work? Hexagon Robotics President Arnaud Robert joins me to explain how the company is moving its Aeon humanoid from pilots and demonstrations into real...

    Credit the people on this episode