Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Tech Talks Daily

Tech Talks Daily artwork

Bringing enterprise AI inference on premises with Scality

Nov 7, 202620 minAudio
ShareXLinkedInFacebookWhatsAppEmail

What should a business consider before moving AI inference onto infrastructure it owns? In this episode of Tech Talks Daily, I speak with Paul Speciale, Chief Marketing Officer at Scality, about the decisions behind enterprise AI infrastructure. Following the launch of Scality AI Inference Factory, we discuss why organizations are assessing on-premises inference alongside cloud services, with attention to costs, model control and the location of sensitive data. Paul expects a hybrid approach, with different workloads running in the environments that suit their requirements. The conversation begins with the work a GPU repeats when an AI session needs to process familiar context. Paul explains how saving and retrieving that information can reduce recomputation, and why storage and networking deserve attention alongside compute. We discuss where the economics change as usage grows and why owning the infrastructure also means taking responsibility for utilization, performance and the operating bill. We then consider data placement across storage tiers. Paul argues that there is no single best location for every workload, with performance, cost and sovereignty requirements shaping the decision. I ask where automation should stop and human approval should begin. He describes automating health checks, forecasts and recommendations while retaining approval for consequential changes such as deleting data or changing policies. Cyber resilience is another part of the discussion. Paul explains why an immutable copy needs to be supported by tested recovery, and why sovereignty rules should be checked through attempts to perform actions the system is meant to refuse. We close with the responsibilities infrastructure teams take on as they manage inference directly, from tracking time to first token and context reuse to deciding when a model should change. For leaders assessing their next AI deployment, the conversation offers practical questions about control and the evidence behind the business case. Which workloads would you consider running locally, and what would you want to prove before making that decision? Please share your thoughts with me.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. IGEL Reaches Unicorn Status and Why Endpoint Resilience Matters Now

    Nov 20, 202624 minAudio

    What does IGEL reaching unicorn status mean for the customers and people behind the company? It was lovely to welcome my friend Klaus back to Tech Talks Daily for a conversation that felt like a catch-up with some...

    Credit the people on this episode

  2. How to Verify AI Research Before Acting with AlphaSense

    Nov 19, 202625 minAudio

    Would you put an AI answer in front of your board if you couldn't tell which source supported its most important claim? On Tech Talks Daily, I'm joined by Julia Lecocq, who leads corporate sales in Europe and...

    Credit the people on this episode

  3. From Security Alert to Verified Fix with Cogent Security

    Nov 18, 202619 minAudio

    How much time passes between discovering a vulnerability and getting the right person to fix it? On Tech Talks Daily, I'm joined by Vineet Edupuganti, co-founder and CEO of Cogent Security, to talk about the work that...

    Credit the people on this episode

  4. Measuring the True Cost of AI With Front

    Nov 17, 202623 minAudio

    What does AI really cost when a cheap model fails, retries the task, hands the work to a person, and leaves the customer returning with the same problem? In this episode of Tech Talks Daily, I welcome back Dan...

    Credit the people on this episode

  5. Making Time For Real Work With AI and lilAgents

    Nov 17, 202637 minAudio

    When AI saves you time, who gets to decide what happens to the time you get back? On Tech Talks Daily, I welcome back David V. Kimball, co-founder and CEO of lilAgents. David started working remotely in 2018, after most...

    Credit the people on this episode