Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in
Data Engineering Podcast artwork

Podcast

Data Engineering Podcast

Tobias Macey

Technology · 521 episodes
  • Website
Follow

Guests who follow get this show's guest call alerts.

Subscribe+ Add a creditShare

This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.

Listen on
  • Apple Podcasts
  • Find on Spotify
EpisodesPeoplePostsSubscribe

Is this your show? Claim this page

Information

Creator
Tobias Macey
Category
Technology
Years active
2017 to 2026
Episodes
521
Copyright
© 2025 Boundless Notions, LLC.
Show website
dataengineeringpodcast.com

Sign in to suggest a network

PodCred

The people behind this show

People get invited back because someone remembered they were great.

PodCred is the verified record of who made this show. A credit here means people who were there confirmed the work.

Hosts

11 people
  • Tobias MaceyHost, 520 episodesFeed-stated
  • M
    Matthew RocklinHost, Dask with Matthew Rocklin - Episode 2Feed-stated
  • Nikita ShamgunovHost, 2 episodesFeed-stated
  • H
    Hannes MühleisenHost, Move Your Database To The Data And Speed Up Your Analytics With DuckDBFeed-stated
  • Praveen GujarHost, The Role of Product Managers in Data-Centric OrganizationsFeed-stated
  • Michel TricotHost, Scaling Airbyte: Challenges and Milestones on the Road to 1.0Feed-stated
  • B
    Burak KarakanHost, An Opinionated Look At End-to-end Code Only Analytical Workflows With BruinFeed-stated
  • M
    Marc BrookerHost, From RAG to Relational: How Agentic Patterns Are Reshaping Data ArchitectureFeed-stated
  • B
    Brijesh TripathiHost, From GPUs-as-a-Service to Workloads-as-a-Service: Flex AI’s Path to High-Utilization AI InfraFeed-stated
  • J
    Jevin MaltaisHost, Holding Kafka Right: Product-Friendly Streaming with TypeStreamFeed-stated
  • P
    Prukalpa SankarHost, Building the Context Flywheel for AI Data AgentsFeed-stated
Showing 5 of 11

Guests

63 guests
  • V
    Victor Kesslerguest, Advanced Lakehouse Management With The LakeKeeper Iceberg REST CatalogFeed-stated
  • X
    Xinyu Zhengguest, Unfreezing The Data Lake: The Future-Proof File FormatFeed-stated
  • D
    Daniel WhitenackGuest, Pachyderm with Daniel Whitenack - Episode 1Feed-stated
  • S
    Sean T. AllenGuest, Wallaroo with Sean T. Allen - Episode 12Feed-stated
  • G
    Gleb MezhanskiyGuest, 3 episodesFeed-stated
  • K
    Kevin LiuGuest, Being Data Driven At Stripe With Trino And IcebergFeed-stated
  • D
    Dipti BorkarGuest, Stitching Together Enterprise Analytics With Microsoft FabricFeed-stated
  • P
    Petr JandaGuest, Improve Data Quality Through Engineering Rigor And Business Engagement With SynqFeed-stated
  • Lior GavishGuest, How Generative AI Is Impacting Data Engineering TeamsFeed-stated
  • Tom BaeyensGuest, Achieving Data Reliability: The Role of Data Contracts in Modern Data ManagementFeed-stated
  • Chris BerghGuest, The Evolution of DataOps: Insights from DataKitchen's CEOFeed-stated
  • Junping DuGuest, Enhancing Data Accessibility and Governance with GravitinoFeed-stated
  • Lukas SchulteGuest, Build Your Data Transformations Faster And Safer With SDFFeed-stated
  • Marcin RudolfGuest, The Role of Python in Shaping the Future of Data Platforms with DLTFeed-stated
  • Adrian BrudaruGuest, The Role of Python in Shaping the Future of Data Platforms with DLTFeed-stated
  • Weston PaceGuest, Bring Vector Search And Storage To The Data Lake With LanceFeed-stated
  • Gleb MezhanskiyGuest, 2 episodesFeed-stated
  • Mihai BudiuGuest, Feldera: Bridging Batch and Streaming with Incremental ComputationFeed-stated
  • Lalith SureshGuest, Feldera: Bridging Batch and Streaming with Incremental ComputationFeed-stated
  • Leonid RyzhykGuest, Feldera: Bridging Batch and Streaming with Incremental ComputationFeed-stated
  • K
    Ken PickeringGuest, Streaming Data Into The Lakehouse With Iceberg And Trino At GoingFeed-stated
  • A
    Anna GellerGuest, Bridging Code and UI in Data Orchestration with KestraFeed-stated
  • S
    Sam KleinmanGuest, The Art of Database Selection and EvolutionFeed-stated
  • M
    Maxime BeaucheminGuest, 2 episodesFeed-stated
  • H
    Hugo LuGuest, How Orchestration Impacts Data Platform ArchitectureFeed-stated
  • L
    Lior BarakGuest, Building a Data Vision Board: A Guide to Strategic PlanningFeed-stated
  • D
    Daniel BrucknerGuest, Breaking Down Data Silos: AI and ML in Master Data ManagementFeed-stated
  • A
    Andrew LuoGuest, CSVs Will Never Die And OneSchema Is Counting On ItFeed-stated
  • B
    Bartosz MikulskiGuest, Evolving Responsibilities in AI Data ManagementFeed-stated
  • R
    Rajan GoyalGuest, Accelerated Computing in Modern Data Centers With DatapelagoFeed-stated
  • P
    Pete DeJoyGuest, Astronomer's Role in the Airflow Ecosystem: A Deep Dive with Pete DeJoyFeed-stated
  • R
    Roman GershmanGuest, Overcoming Redis Limitations: The Dragonfly DB ApproachFeed-stated
  • J
    Jeremy EdbergGuest, Simplifying Data Pipelines with Durable ExecutionFeed-stated
  • V
    Viktor KesslerGuest, Advanced Lakehouse Management With The LakeKeeper Iceberg REST CatalogFeed-stated
  • D
    Derek CollisonGuest, Exploring NATS: A Multi-Paradigm Connectivity Layer for Distributed ApplicationsFeed-stated
  • T
    Tulika BhattGuest, Balancing Off-the-Shelf and Custom Solutions in Data EngineeringFeed-stated
  • S
    Shinji KimGuest, From Data Discovery to AI: The Evolution of Semantic LayersFeed-stated
  • C
    Chakravarthy KotaruGuest, Scaling Data Operations With Platform EngineeringFeed-stated
  • M
    Mai-Lan Tomsen BukovecGuest, Amazon S3: The Backbone of Modern Data SystemsFeed-stated
  • A
    Alex AlbuGuest, AI and the Lakehouse: How Starburst is Pioneering New WorkflowsFeed-stated
  • N
    Nick SchrockGuest, 2 episodesFeed-stated
  • A
    Arun JosephGuest, Enabling Agents In The Enterprise With A Platform ApproachFeed-stated
  • E
    Effie BaramGuest, Foundational Data Engineering At Two SigmaFeed-stated
  • K
    Kacper ŁukawskiGuest, Streamlining Data Pipelines with MCP Servers and Vector EnginesFeed-stated
  • D
    Dan SotolongoGuest, Warehouse Native Incremental Data Processing With Dynamic Tables And Delayed View SemanticsFeed-stated
  • A
    Akshay AgrawalGuest, Revolutionizing Python Notebooks with MarimoFeed-stated
  • A
    Andy WarfieldGuest, From Bits to Tables: The Evolution of S3 StorageFeed-stated
  • D
    Drew GilsonGuest, Bridging Data and Decision-Making: AI's Role in Modern AnalyticsFeed-stated
  • L
    Lucas ThelosenGuest, Bridging Data and Decision-Making: AI's Role in Modern AnalyticsFeed-stated
  • P
    Prashanth RaoGuest, High Performance And Low Overhead Graphs With KuzuDBFeed-stated
  • P
    Paul GrothGuest, From Academia to Industry: Bridging Data Engineering ChallengesFeed-stated
  • S
    Serge GershkovichGuest, Aligning Business and Data: The Essential Role of Data ModelingFeed-stated
  • M
    Mark RaasveldtGuest, Duck Lake: Simplifying the Lakehouse EcosystemFeed-stated
  • H
    Hannes MühleisenGuest, Duck Lake: Simplifying the Lakehouse EcosystemFeed-stated
  • K
    Kate ShawGuest, The True Costs of Legacy Systems: Technical Debt, Risk, and Exit StrategiesFeed-stated
  • M
    Matt TopperGuest, Beyond the Perimeter: Practical Patterns for Fine‑Grained Data AccessFeed-stated
  • I
    Ido BronsteinGuest, Bridging the AI–Data Gap: Collect, Curate, ServeFeed-stated
  • O
    Omri LifshitzGuest, Bridging the AI–Data Gap: Collect, Curate, ServeFeed-stated
  • A
    Ariel PohorylesGuest, The AI Data Paradox: High Trust in Models, Low Trust in DataFeed-stated
  • P
    Preeti SomalGuest, State, Scale, and Signals: Rethinking Orchestration with Durable ExecutionFeed-stated
  • M
    Michael ToyGuest, Malloy: Hierarchical Data, Semantic Models, and the Future of AnalyticsFeed-stated
  • S
    Suresh SrinivasGuest, From Context to Semantics: How Metadata Powers Agentic AIFeed-stated
  • S
    Sriharsha ChintalapaniGuest, From Context to Semantics: How Metadata Powers Agentic AIFeed-stated
Showing 5 of 63

Who is on this show?

Think of the guest you still think about. The producer who makes the host sound smart. The editor who saves every episode. If a name is missing here, that person is invisible everywhere.

Add a credit

Episodes

521 episodes
521 episodes
  1. Entity Resolution at Scale: Graphs, LLMs, and Real-World Data Messiness

    Nov 1, 202659 minAudio

    Summary In this episode, I spoke with Steven Renwick, CEO and co-founder of Tilores, about the realities of entity-oriented data processing and the practical role of LLMs in entity resolution. We covered the confusing...

    Credit the people on this episode

  2. How Amazon Uses Telemetry and AI to Automate Physical Logistics

    Oct 20, 202650 minAudio

    Summary In this episode, I spoke with Keerti Kulkarni about the data and AI systems behind physical logistics automation at Amazon. She explained how her team supports dock-door operations across more than 100 North...

    Credit the people on this episode

  3. Why Metadata Still Matters: From Data Catalogs to AI-Ready Semantic Hubs

    Oct 7, 20261 hr 25 minAudio

    Summary In this episode, I spoke with Christian Bremeau and Simon Dynin about their decades-long work in metadata management and how that experience shaped the evolution of Meta Integration Technology and its...

    Credit the people on this episode

  4. Reducing Data Debt with Agile Ledger Architecture

    Sep 24, 202650 minAudio

    Summary In this episode Christopher Doidge talks about his Agile Ledger Architecture (ALA) approach to data warehousing and how it aims to reduce data debt while shortening the path from raw data to trustworthy business...

    Credit the people on this episode

  5. What Context Really Means in Data Engineering and AI

    Sep 15, 202653 minAudio

    Summary In this episode Soham Mazumdar, co-founder and CEO of Wisdom.ai, talks about what “context” really means in data engineering and AI systems. He explores why context has become such an overloaded term, spanning...

    Credit the people on this episode

  6. Specialized AI for Data Engineers: Inside Astronomer’s Otto

    Aug 27, 202646 minAudio

    Summary In this episode Yetunde Dada discusses Otto, Astronomer’s AI agent for Airflow, and the broader challenge of making agentic tooling actually useful for data engineers. She explored why generic coding assistants...

    Credit the people on this episode

  7. Why Multi-Agent Systems Need Shared State, Graph Semantics, and Governance

    Aug 2, 20261 hr 2 minAudio

    Summary In this episode Ragnor Comerford talks about OmniGraph, a lakehouse-native graph storage layer designed around the needs of agentic systems. He explores how graphs are primarily a semantic model for representing...

    Credit the people on this episode

  8. Building the Context Flywheel for AI Data Agents

    Jul 6, 20261 hr 1 minAudio

    Summary In this episode Prukalpa Sankar, co-founder of Atlan, talks about what it takes to build a “context flywheel” for AI agents in data-intensive organizations. She explained why model intelligence alone isn’t...

    Credit the people on this episode

  9. Holding Kafka Right: Product-Friendly Streaming with TypeStream

    Jun 18, 202650 minAudio

    Summary In this episode Jevin Maltais talks about the practical realities of building reliable, product-focused streaming systems with Kafka. Jevin shares lessons from roles at Zapier, Humi, and Clio, where real-time...

    Credit the people on this episode

  10. Text to Data Products: Kaarvi’s End-to-End AI for Ingestion, Quality, and Dashboards

    Jun 8, 202653 minAudio

    Summary In this episode Shravan Gunda, founder and CEO of Kaarvi AI, talks about building an AI-native, agent-driven data platform designed to eliminate the janitorial work that consumes most data teams. He explores...

    Credit the people on this episode

  11. Scaling Graph Analytics Without ETL: Inside PuppyGraph’s Architecture

    Jun 1, 202654 minAudio

    Summary In this episode Weimo Liu, co‑founder of PuppyGraph, talks about the engineering behind their “zero-copy” graph querying engine for lakehouse and database sources. He explores how PuppyGraph lets you run Cypher...

    Credit the people on this episode

  12. Maximizing GPU Utilization: Heterogeneous Pipelines with Ray and Kubernetes

    May 6, 202659 minAudio

    Summary In this episode Robert Nishihara, co-founder of Anyscale and co-creator of Ray, talks about maximizing hardware utilization for AI and data-intensive workloads. He explores Ray’s evolution alongside Kubernetes...

    Credit the people on this episode

  13. The AI-First Data Engineer: 10–50x Productivity and What Changes Next

    Apr 7, 202659 minAudio

    Summary In this episode, I sit down with Gleb Mezhanskiy, CEO and co-founder of Datafold, to explore how agentic AI is reshaping data engineering. We unpack the leap from chat-assisted coding to truly agentic workflows...

    Credit the people on this episode

  14. Treat Metering Like Finance: Building Data Platforms for Consumption Economics

    Mar 29, 202650 minAudio

    Summary In this episode Himant Goyal, Senior Product Manager at Salesforce, talks about how data platform investments enable reliable, accurate metering for consumption-based business models. Himant explains why...

    Credit the people on this episode

  15. Beyond the PDF: Rowan Cockett on Reproducible, Composable Science

    Mar 22, 202643 minAudio

    Summary In this episode Rowan Cockett, co-founder and CEO of CurveNote and co-founder of the Continuous Science Foundation, talks about building data systems that make scientific research reproducible, reusable, and...

    Credit the people on this episode

  16. Beyond Prompts: Practical Paths to Self‑Improving AI

    Mar 16, 20261 hr 2 minAudio

    Summary In this episode Raj Shukla, CTO of SymphonyAI, explores what it really takes to build self‑improving AI systems that work in production. Raj unpacks how agentic systems interact with real-world environments, the...

    Credit the people on this episode

  17. Orion at Gravity: Trustworthy AI Analysts for the Enterprise

    Mar 8, 20261 hr 5 minAudio

    Summary In this episode of the Data Engineering Podcast, Lucas Thelosen and Drew Gilson, co-founders of Gravity, discuss their vision for agentic analytics in the enterprise, enabled by semantic layers and broader...

    Credit the people on this episode

  18. From Models to Momentum: Uniting Architects and Engineers with ER/Studio

    Mar 2, 202645 minAudio

    Summary In this episode of the Data Engineering Podcast, Jamie Knowles (Product Director) and Ryan Hirsch (Product Marketing Manager) discuss the importance of enterprise data modeling with ER/Studio. They highlight how...

    Credit the people on this episode

  19. From Data Models to Mind Models: Designing AI Memory at Scale

    Feb 22, 202658 minAudio

    Summary In this episode of the Data Engineering Podcast, Vasilije "Vas" Markovich, founder of Cognee, discusses building agentic memory, a crucial aspect of artificial intelligence that enables systems to learn, adapt,...

    Credit the people on this episode

  20. Prompt Management, Tracing, and Evals: The New Table Stakes for GenAI Ops

    Feb 15, 202651 minAudio

    Summary In this episode of the Data Engineering Podcast, Aman Agarwal, creator of OpenLit, discusses the operational groundwork required to run LLM-powered applications reliably and cost-effectively. He highlights...

    Credit the people on this episode

  21. From Legacy to AI-Ready: How MongoDB AMP Accelerates Modernization

    Feb 8, 202647 minAudio

    Summary In this episode, Shilpa Kolhar, SVP of Product and Engineering at MongoDB, discusses using MongoDB as a unified foundation for AI-driven and agentic applications. She explains how the Application Modernization...

    Credit the people on this episode

  22. Branches, Diffs, and SQL: How Dolt Powers Agentic Workflows

    Feb 1, 202657 minAudio

    Summary In this episode Tim Sehn, founder and CEO of DoltHub, talks about Dolt - the world’s first version‑controlled SQL database - and why Git‑style semantics belong at the heart of data systems and AI workflows. Tim...

    Credit the people on this episode

  23. Logical First, Physical Second: A Pragmatic Path to Trusted Data

    Jan 25, 202641 minAudio

    Summary In this episode of the Data Engineering Podcast Jamie Knowles, Product Director for ER/Studio, talks about data architecture and its importance in driving business meaning. He discusses how data architecture...

    Credit the people on this episode

  24. Your Data, Your Lake: How Observe Uses Iceberg and Streaming ETL for Observability

    Jan 18, 20261 hr 12 minAudio

    Summary In this episode Jacob Leverich, cofounder and CTO of Observe, talks about applying lakehouse architectures to observability workloads. Jacob discusses Observe’s decision to leverage cloud-native warehousing and...

    Credit the people on this episode

  25. Semantic Operators Meet Dataframes: Building Context for Agents with FENIC

    Jan 12, 202657 minAudio

    Summary In this episode Kostas Pardalis talks about Fenic - an open-source, PySpark-inspired dataframe engine designed to bring LLM-powered semantics into reliable data engineering workflows. Kostas shares why today’s...

    Credit the people on this episode

  26. Beyond Dashboards: How Data Teams Earn a Seat at the Table

    Jan 5, 202649 minAudio

    Summary In this episode Goutham Budati about his Data-Perspective-Action framework and how it empowers data teams to become true business partners. Gautham traces his path from automating Excel reports to leading...

    Credit the people on this episode

  27. Unfreezing The Data Lake: The Future-Proof File Format

    Dec 29, 202559 minAudio

    Summary In this episode PhD researcher Xinyu Zeng talks about F3, the “future-proof file format” designed to address today’s hardware realities and evolving workloads. He digs into the limitations of Parquet and ORC -...

    Credit the people on this episode

  28. From Context to Semantics: How Metadata Powers Agentic AI

    Dec 21, 20251 hr 6 minAudio

    Summary In this episode Suresh Srinivas and Sriharsha Chintalapani explore how metadata platforms are evolving from human-centric catalogs into the foundational context layer for AI and agentic systems. They discuss the...

    Credit the people on this episode

  29. From Data Engineering to AI Engineering: Where the Lines Blur

    Dec 14, 202527 minAudio

    Summary In this solo episode of the Data Engineering Podcast, host Tobias Macey reflects on how AI has transformed the practice and pace of data engineering over time. Starting from its origins in the Hadoop and cloud...

    Credit the people on this episode

  30. Malloy: Hierarchical Data, Semantic Models, and the Future of Analytics

    Dec 8, 202559 minAudio

    Summary In this episode Michael Toy, co-creator of Malloy, talks about rethinking how we work with data beyond SQL. Michael shares the origins of Malloy from his and Lloyd Tabb’s experience at Looker, why SQL’s mental...

    Credit the people on this episode

  31. Blurring Lines: Data, AI, and the New Playbook for Team Velocity

    Nov 24, 20251 hr 1 minAudio

    Summary In this crossover episode, Max Beauchemin explores how multiplayer, multi‑agent engineering is transforming the way individuals and teams build data and AI systems. He digs into the shifting boundary between...

    Credit the people on this episode

  32. State, Scale, and Signals: Rethinking Orchestration with Durable Execution

    Nov 16, 202552 minAudio

    Summary In this episode Preeti Somal, EVP of Engineering at Temporal, talks about the durable execution model and how it reshapes the way teams build reliable, stateful systems for data and AI. She explores Temporal’s...

    Credit the people on this episode

  33. The AI Data Paradox: High Trust in Models, Low Trust in Data

    Nov 9, 202552 minAudio

    Summary In this episode of the Data Engineering Podcast Ariel Pohoryles, head of product marketing for Boomi's data management offerings, talks about a recent survey of 300 data leaders on how organizations are...

    Credit the people on this episode

  34. Bridging the AI–Data Gap: Collect, Curate, Serve

    Nov 2, 202551 minAudio

    Summary In this episode of the Data Engineering Podcast Omri Lifshitz (CTO) and Ido Bronstein (CEO) of Upriver talk about the growing gap between AI's demand for high-quality data and organizations' current data...

    Credit the people on this episode

  35. Beyond the Perimeter: Practical Patterns for Fine‑Grained Data Access

    Oct 27, 20251 hr 5 minAudio

    Summary In this episode of the Data Engineering Podcast Matt Topper, president of UberEther, talks about the complex challenge of identity, credentials, and access control in modern data platforms. With the shift to...

    Credit the people on this episode

  36. The True Costs of Legacy Systems: Technical Debt, Risk, and Exit Strategies

    Oct 18, 20251 hr 4 minAudio

    Summary In this episode Kate Shaw, Senior Product Manager for Data and SLIM at SnapLogic, talks about the hidden and compounding costs of maintaining legacy systems - and practical strategies for modernization. She...

    Credit the people on this episode

  37. Context Engineering as a Discipline: Building Governed AI Analytics

    Oct 11, 202552 minAudio

    Summary In this episode of the Data Engineering Podcast, host Tobias Macey welcomes back Nick Schrock, CTO and founder of Dagster Labs, to discuss Compass - a Slack-native, agentic analytics system designed to keep data...

    Credit the people on this episode

  38. The Data Model That Captures Your Business: Metric Trees Explained

    Oct 5, 20251 hr 1 minAudio

    Summary In this episode of the Data Engineering Podcast Vijay Subramanian, founder and CEO of Trace, talks about metric trees - a new approach to data modeling that directly captures a company's business model. Vijay...

    Credit the people on this episode

  39. From GPUs-as-a-Service to Workloads-as-a-Service: Flex AI’s Path to High-Utilization AI Infra

    Sep 28, 202557 minAudio

    Summary In this crossover episode of the AI Engineering Podcast, host Tobias Macey interviews Brijesh Tripathi, CEO of Flex AI, about revolutionizing AI engineering by removing DevOps burdens through "workload as a...

    Credit the people on this episode

  40. From RAG to Relational: How Agentic Patterns Are Reshaping Data Architecture

    Sep 18, 202553 minAudio

    Summary In this episode of the AI Engineering Podcast Mark Brooker, VP and Distinguished Engineer at AWS, talks about how agentic workflows are transforming database usage and infrastructure design. He discusses the...

    Credit the people on this episode

  41. Duck Lake: Simplifying the Lakehouse Ecosystem

    Sep 10, 20251 hr 11 minAudio

    Summary In this episode of the Data Engineering Podcast Hannes Mühleisen and Mark Raasveldt, the creators of DuckDB, share their work on Duck Lake, a new entrant in the open lakehouse ecosystem. They discuss how Duck...

    Credit the people on this episode

  42. Aligning Business and Data: The Essential Role of Data Modeling

    Sep 1, 20251 hr 7 minAudio

    Summary In this episode of the Data Engineering Podcast Serge Gershkovich, head of product at SQL DBM, talks about the socio-technical aspects of data modeling. Serge shares his background in data modeling and...

    Credit the people on this episode

  43. From Academia to Industry: Bridging Data Engineering Challenges

    Aug 26, 202551 minAudio

    Summary In this episode of the Data Engineering Podcast Professor Paul Groth, from the University of Amsterdam, talks about his research on knowledge graphs and data engineering. Paul shares his background in AI and...

    Credit the people on this episode

  44. High Performance And Low Overhead Graphs With KuzuDB

    Aug 18, 20251 hr 1 minAudio

    Summary In this episode of the Data Engineering Podcast Prashanth Rao, an AI engineer at KuzuDB, talks about their embeddable graph database. Prashanth explains how KuzuDB addresses performance shortcomings in existing...

    Credit the people on this episode

  45. Bridging Data and Decision-Making: AI's Role in Modern Analytics

    Aug 12, 20251 hr 11 minAudio

    Summary In this episode of the Data Engineering Podcast Lucas Thelosen and Drew Gilson from Gravity talk about their development of Orion, an autonomous data analyst that bridges the gap between data availability and...

    Credit the people on this episode

  46. From Bits to Tables: The Evolution of S3 Storage

    Aug 5, 202550 minAudio

    Summary In this episode of the Data Engineering Podcast Andy Warfield talks about the innovative functionalities of S3 Tables and Vectors and their integration into modern data stacks. Andy shares his journey through...

    Credit the people on this episode

  47. Revolutionizing Python Notebooks with Marimo

    Jul 28, 202552 minAudio

    Summary In this episode of the Data Engineering Podcast Akshay Agrawal from Marimo discusses the innovative new Python notebook environment, which offers a reactive execution model, full Python integration, and built-in...

    Credit the people on this episode

  48. Warehouse Native Incremental Data Processing With Dynamic Tables And Delayed View Semantics

    Jul 21, 202555 minAudio

    Summary In this episode of the Data Engineering Podcast Dan Sotolongo from Snowflake talks about the complexities of incremental data processing in warehouse environments. Dan discusses the challenges of handling...

    Credit the people on this episode

  49. Streamlining Data Pipelines with MCP Servers and Vector Engines

    Jul 15, 202552 minAudio

    Summary In this episode of the Data Engineering Podcast Kacper Łukawski from Qdrant about integrating MCP servers with vector databases to process unstructured data. Kacper shares his experience in data engineering,...

    Credit the people on this episode

  50. Foundational Data Engineering At Two Sigma

    Jul 6, 202555 minAudio

    Summary In this episode of the Data Engineering Podcast Effie Baram, a leader in foundational data engineering at Two Sigma, talks about the complexities and innovations in data engineering within the finance sector....

    Credit the people on this episode

  51. Enabling Agents In The Enterprise With A Platform Approach

    Jun 29, 202554 minAudio

    Summary In this episode of the Data Engineering Podcast Arun Joseph talks about developing and implementing agent platforms to empower businesses with agentic capabilities. From leading AI engineering at Deutsche...

    Credit the people on this episode

  52. Dagster's New Era: Modularizing Data Transformation in the Age of AI

    Jun 18, 20251 hr 2 minAudio

    Summary In this episode of the Data Engineering Podcast we welcome back Nick Schrock, CTO and founder of Dagster Labs, to discuss the evolving landscape of data engineering in the age of AI. As AI begins to impact data...

    Credit the people on this episode

  53. AI and the Lakehouse: How Starburst is Pioneering New Workflows

    Jun 11, 202544 minAudio

    Summary In this episode of the Data Engineering Podcast Alex Albu, tech lead for AI initiatives at Starburst, talks about integrating AI workloads with the lakehouse architecture. From his software engineering roots to...

    Credit the people on this episode

  54. Amazon S3: The Backbone of Modern Data Systems

    Jun 3, 20251 hr 1 minAudio

    Summary In this episode of the Data Engineering Podcast Mai-Lan Tomsen Bukovec, Vice President of Technology at AWS, talks about the evolution of Amazon S3 and its profound impact on data architecture. From her work on...

    Credit the people on this episode

  55. Scaling Data Operations With Platform Engineering

    May 29, 202542 minAudio

    Summary In this episode of the Data Engineering Podcast Chakravarthy Kotaru talks about scaling data operations through standardized platform offerings. From his roots as an Oracle developer to leading the data platform...

    Credit the people on this episode

  56. From Data Discovery to AI: The Evolution of Semantic Layers

    May 21, 202550 minAudio

    Summary In this episode of the Data Engineering Podcast, host Tobias Macy welcomes back Shinji Kim to discuss the evolving role of semantic layers in the era of AI. As they explore the challenges of managing vast data...

    Credit the people on this episode

  57. Balancing Off-the-Shelf and Custom Solutions in Data Engineering

    May 13, 202546 minAudio

    Summary In this episode of the Data Engineering Podcast Tulika Bhatt, a senior software engineer at Netflix, talks about her experiences with large-scale data processing and the future of data engineering technologies....

    Credit the people on this episode

  58. StarRocks: Bridging Lakehouse and OLAP for High-Performance Analytics

    May 5, 20251 hrAudio

    Summary In this episode of the Data Engineering Podcast Sida Shen, product manager at CelerData, talks about StarRocks, a high-performance analytical database. Sida discusses the inception of StarRocks, which was forked...

    Credit the people on this episode

  59. Exploring NATS: A Multi-Paradigm Connectivity Layer for Distributed Applications

    Apr 28, 20251 hr 13 minAudio

    Summary In this episode of the Data Engineering Podcast Derek Collison, creator of NATS and CEO of Synadia, talks about the evolution and capabilities of NATS as a multi-paradigm connectivity layer for distributed...

    Credit the people on this episode

  60. Advanced Lakehouse Management With The LakeKeeper Iceberg REST Catalog

    Apr 21, 202557 minAudio

    Summary In this episode of the Data Engineering Podcast Viktor Kessler, co-founder of Vakmo, talks about the architectural patterns in the lake house enabled by a fast and feature-rich Iceberg catalog. Viktor shares his...

    Credit the people on this episode

  61. Simplifying Data Pipelines with Durable Execution

    Apr 12, 202540 minAudio

    Summary In this episode of the Data Engineering Podcast Jeremy Edberg, CEO of DBOS, about durable execution and its impact on designing and implementing business logic for data systems. Jeremy explains how DBOS's...

    Credit the people on this episode

  62. Overcoming Redis Limitations: The Dragonfly DB Approach

    Mar 30, 202544 minAudio

    Summary In this episode of the Data Engineering Podcast Roman Gershman, CTO and founder of Dragonfly DB, explores the development and impact of high-speed in-memory databases. Roman shares his experience creating a more...

    Credit the people on this episode

  63. Bringing AI Into The Inner Loop of Data Engineering With Ascend

    Mar 24, 202553 minAudio

    Summary In this episode of the Data Engineering Podcast Sean Knapp, CEO of Ascend.io, explores the intersection of AI and data engineering. He discusses the evolution of data engineering and the role of AI in automating...

    Credit the people on this episode

  64. Astronomer's Role in the Airflow Ecosystem: A Deep Dive with Pete DeJoy

    Mar 16, 202552 minAudio

    Summary In this episode of the Data Engineering Podcast Pete DeJoy, co-founder and product lead at Astronomer, talks about building and managing Airflow pipelines on Astronomer and the upcoming improvements in Airflow...

    Credit the people on this episode

  65. Accelerated Computing in Modern Data Centers With Datapelago

    Mar 8, 202556 minAudio

    Summary In this episode of the Data Engineering Podcast Rajan Goyal, CEO and co-founder of Datapelago, talks about improving efficiencies in data processing by reimagining system architecture. Rajan explains the shift...

    Credit the people on this episode

  66. The Future of Data Engineering: AI, LLMs, and Automation

    Feb 26, 20251 hrAudio

    Summary In this episode of the Data Engineering Podcast Gleb Mezhanskiy, CEO and co-founder of DataFold, talks about the intersection of AI and data engineering. He discusses the challenges and opportunities of...

    Credit the people on this episode

  67. Evolving Responsibilities in AI Data Management

    Feb 16, 202539 minAudio

    Summary In this episode of the Data Engineering Podcast Bartosz Mikulski talks about preparing data for AI applications. Bartosz shares his journey from data engineering to MLOps and emphasizes the importance of data...

    Credit the people on this episode

  68. CSVs Will Never Die And OneSchema Is Counting On It

    Jan 13, 202555 minAudio

    Summary In this episode of the Data Engineering Podcast Andrew Luo, CEO of OneSchema, talks about handling CSV data in business operations. Andrew shares his background in data engineering and CRM migration, which led...

    Credit the people on this episode

  69. Breaking Down Data Silos: AI and ML in Master Data Management

    Jan 3, 202558 minAudio

    Summary In this episode of the Data Engineering Podcast Dan Bruckner, co-founder and CTO of Tamr, talks about the application of machine learning (ML) and artificial intelligence (AI) in master data management (MDM)....

    Credit the people on this episode

  70. Building a Data Vision Board: A Guide to Strategic Planning

    Dec 23, 202450 minAudio

    Summary In this episode of the Data Engineering Podcast Lior Barak shares his insights on developing a three-year strategic vision for data management. He discusses the importance of having a strategic plan for data,...

    Credit the people on this episode

  71. How Orchestration Impacts Data Platform Architecture

    Dec 16, 20241 hrAudio

    Summary The core task of data engineering is managing the flows of data through an organization. In order to ensure those flows are executing on schedule and without error is the role of the data orchestrator. Which...

    Credit the people on this episode

  72. An Exploration Of The Impediments To Reusable Data Pipelines

    Dec 8, 202452 minAudio

    Summary In this episode of the Data Engineering Podcast the inimitable Max Beauchemin talks about reusability in data pipelines. The conversation explores the "write everything twice" problem, where similar pipelines...

    Credit the people on this episode

  73. The Art of Database Selection and Evolution

    Dec 1, 20241 hrAudio

    Summary In this episode of the Data Engineering Podcast Sam Kleinman talks about the pivotal role of databases in software engineering. Sam shares his journey into the world of data and discusses the complexities of...

    Credit the people on this episode

  74. Bridging Code and UI in Data Orchestration with Kestra

    Nov 26, 202445 minAudio

    Summary In this episode of the Data Engineering Podcast, Anna Geller talks about the integration of code and UI-driven interfaces for data orchestration. Anna defines data orchestration as automating the coordination of...

    Credit the people on this episode

  75. Streaming Data Into The Lakehouse With Iceberg And Trino At Going

    Nov 18, 202440 minAudio

    In this episode, I had the pleasure of speaking with Ken Pickering, VP of Engineering at Going, about the intricacies of streaming data into a Trino and Iceberg lakehouse. Ken shared his journey from product engineering...

    Credit the people on this episode

  76. An Opinionated Look At End-to-end Code Only Analytical Workflows With Bruin

    Nov 11, 202456 minAudio

    Summary The challenges of integrating all of the tools in the modern data stack has led to a new generation of tools that focus on a fully integrated workflow. At the same time, there have been many approaches to how...

    Credit the people on this episode

  77. Feldera: Bridging Batch and Streaming with Incremental Computation

    Nov 4, 202448 minAudio

    Summary In this episode of the Data Engineering Podcast, the creators of Feldera talk about their incremental compute engine designed for continuous computation of data, machine learning, and AI workloads. The...

    Credit the people on this episode

  78. Accelerate Migration Of Your Data Warehouse with Datafold's AI Powered Migration Agent

    Oct 27, 202449 minAudio

    Summary Gleb Mezhanskiy, CEO and co-founder of DataFold, joins Tobias Macey to discuss the challenges and innovations in data migrations. Gleb shares his experiences building and scaling data platforms at companies like...

    Credit the people on this episode

  79. Bring Vector Search And Storage To The Data Lake With Lance

    Oct 20, 202458 minAudio

    Summary The rapid growth of generative AI applications has prompted a surge of investment in vector databases. While there are numerous engines available now, Lance is designed to integrate with data lake and lakehouse...

    Credit the people on this episode

  80. The Role of Python in Shaping the Future of Data Platforms with DLT

    Oct 13, 202454 minAudio

    Summary In this episode of the Data Engineering Podcast, Adrian Broderieux and Marcin Rudolph, co-founders of DLT Hub, delve into the principles guiding DLT's development, emphasizing its role as a library rather than a...

    Credit the people on this episode

Show moreShowing 80 of 521

Posts

No posts yet. Posts Data Engineering Podcast shares on PodSubs, and what it publishes on Substack, YouTube and its own site, will show here.

Be the first to rate this show

Subscribe

Be on the front line of the show

Everything Data Engineering Podcast sends its own people, first. Resources, announcements, behind the scenes, events, and giveaways, straight from the host. No account needed.

  • The resources the host shares with subscribers
  • Announcements before anyone else hears
  • Behind the scenes from the team
  • Events, invitations, and giveaways
  • Only what the host sends, nothing else
How often

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Report this show

Similar shows

  • AI Engineering Podcast artwork

    AI Engineering Podcast

    Shares 7 people with this show

    82 episodes

    Updated Oct 15, 2026

  • Kim Komando Daily Tech Update artwork

    Kim Komando Daily Tech Update

    Also in Technology

    4,864 episodes

    Updated Nov 21, 2026

  • Rebuild artwork

    Rebuild

    Also in Technology

    561 episodes

    Updated Nov 21, 2026

  • Dad Reviews with @LaneVids (Svenska) artwork

    Dad Reviews with @LaneVids (Svenska)

    Also in Technology

    115 episodes

    Updated Nov 21, 2026

  • Tech Café : tech & IA artwork

    Tech Café : tech & IA

    Also in Technology

    561 episodes

    Updated Nov 21, 2026

  • Dad Reviews with @LaneVids (Deutsch) artwork

    Dad Reviews with @LaneVids (Deutsch)

    Also in Technology

    279 episodes

    Updated Nov 21, 2026

  • Dad Reviews with @LaneVids (Português) artwork

    Dad Reviews with @LaneVids (Português)

    Also in Technology

    278 episodes

    Updated Nov 21, 2026

  • Dad Reviews with @LaneVids (日本語) artwork

    Dad Reviews with @LaneVids (日本語)

    Also in Technology

    278 episodes

    Updated Nov 21, 2026