Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Coder Radio

Coder Radio artwork

636: Red Hat's James Huang

Dec 19, 202521 minAudio

Links James on LinkedIn Mike on LinkedIn Mike's Blog Show on Discord Alice Promo AI on Red Hat Enterprise Linux (RHEL) Trust and Stability: RHEL provides the mission-critical foundation needed for workloads where security and reliability cannot be compromised. Predictive vs. Generative: Acknowledging the hype of GenAI while maintaining support for traditional machine learning algorithms. Determinism: The challenge of bringing consistency and security to emerging AI technologies in production environments. Rama-Llama & Containerization Developer Simplicity: Rama-Llama helps developers run local LLMs easily without being "locked in" to specific engines; it supports Podman, Docker, and various inference engines like Llama.cpp and Whisper.cpp. Production Path: The tool is designed to "fade away" after helping package the model and stack into a container that can be deployed directly to Kubernetes. Behind the Firewall: Addressing the needs of industries (like aircraft maintenance) that require AI to stay strictly on-premises. Enterprise AI Infrastructure Red Hat AI: A commercial product offering tools for model customization, including pre-training, fine-tuning, and RAG (Retrieval-Augmented Generation). Inference Engines: James highlights the difference between Llama.cpp (for smaller/edge hardware) and vLLM, which has become the enterprise standard for multi-GPU data center inferencing.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Hosts

  • Michael Dominick host Feed-stated

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. 662: Chris Fisher

    Nov 16, 202655 minAudio

    🚨 THE REUNION EPISODE: Chris Fisher Returns to Coder Radio! 🚨 Wait... check your podcast feeds, check what year it is, and adjust your headphones - because Chris Fisher is BACK in the guest chair! We know how much the...

    Credit the people on this episode

  2. 661: env zero

    Nov 13, 202624 minAudio

    Mike sits down with the fellas from env zero to talk some intelligent cloud governance and infrastructure. env zero Chris on LinkedIn Mike on LinkedIn Coder Radio Discord Alderon Games The Mad Botter INC

    Credit the people on this episode

  3. 660: Return of the Prof

    Nov 2, 202647 minAudio

    Mike is joined once again by Professor Seely to discuss extra-curricular educational opportunities for aspiring developers and the impact both good and not so good of the current AI landscape on Jr roles. Prof Andrew on...

    Credit the people on this episode

  4. 659: Checking In

    Oct 23, 202613 minAudio

    We're back from our brief fall hiatus; we took it in the fall instead of over the holiday break this year. We also have a quick news rundown.

    Credit the people on this episode

  5. 658: Games Dev With Grenis

    Sep 17, 202624 minAudio

    Alderon Games [Warp](warp.dev) [The Mad Botter Automation Promo](themadbotter.com/start) Discord Coder Conduit

    Credit the people on this episode