Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Kodsnack

Kodsnack artwork

Kodsnack 654 - German-style strings, with Matt Topol

Aug 5, 202553 minAudio

Fredrik talks to Matt Topol about Arrow and how the Arrow ecosystem is evolving. Arrow is an open source, columnar in-memory data format designed for efficient data processing and analytics - which means passing data between things without needing to transform it, and ideally even without needing to copy it. What makes the ecosystem grow, and why is it very cool to have Arrow on the GPU? What is the connection between Arrow, machine learning, and Hugging face? Matt emphasizes the value of open standards, even as they work with or within more closed systems they can help open things up, and help bring about more modular solutions so that developers can focus on doing their core area really well. This episode can be seen as a follow-up to episode 567, where Matt first joined to discuss everything Arrow. Recorded during Øredev 2024. Thank you Cloudnet for sponsoring our VPS! Comments, questions or tips? We a re @kodsnack, @tobiashieta, @oferlundand @bjoreman on Twitter, have a page on Facebook and can be emailed at info@kodsnack.se if you want to write longer. We read everything we receive. If you enjoy Kodsnack we would love a review in iTunes! You can also support the podcast by buying us a coffee (or two!) through Ko-fi. Links Matt Matt's Øredev 2023 talks: State of the Apache Arrow ecosystem: How your project can leverage Arrow! and Leveraging Apache Arrow for ML workflows Previous episodes with Matt Øredev 2024 Matt's Øredev 2024 talks - on Arrow ADBC and Composable and modular data systems ADBC - Arrow database connectivity Arrow Snowflake Snowflake drivers for ADBC Bigquery The Bigquery driver Microsoft Fabric Duckdb Postgres SQLite Arrow flight - RPC framework for services based on Arrow data Arrow flight SQL Microsoft Power BI Velox Apache datafusion Query planning Substrait - query IR Polaris Libcudf Nvidia RAPIDS Pytorch Tensorflow Arrow device interface DLPack - in-memory tensor structure Tensors Nanoarrow Voltron data - where Matt used to work. He's now at Columnar Theseus GPU compute engine The composable data management system manifesto Support us on Ko-fi! Matt's book - In-memory analytics with Apache Arrow Spark Spark connect RPC UDFs Photon Datafusion Apache Cassandra ODBC JDBC R - programming language for statistical computing Hugging face Ray Stringview - "German-style strings" Scaling up with R and Arrow - the book on using Arrow with R Titles It's gotten a lot bigger The bones of it are in the repo (Powered by ADBC) Individual compute components Feed it substrate Where the ecosystem is going Arrow on the GPU The data stays on the GPU A forced copy Leverage that device interface Without forcing the copy Shy of that last mile Turtles all the way down The guy who said yes German-style strings

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Kodsnack 729 - En galax av missade möjligheter

    Nov 17, 202645 minAudio

    Fredrik snackar om 2026 års upplagor av Goatmire Elixir och Øredev. Levde Goatmire upp till den otroliga nivån från 2005? Hur var korridorspåret? Hann Fredrik se några presentationer under Øredev, och vilka tankar har...

    Credit the people on this episode

  2. Kodsnack 728 - C och DLL:er, med Jona Ekenberg

    Nov 10, 202659 minAudio

    Fredrik och Jona Ekenberg snackar om Jonas senaste textredigerarprojekt. Sist vi talades vid hade Jona skrivit Freja och upplevt vissa prestandaproblem. Sedan dess har han både funderat över fiskmåsar, skrivit en egen...

    Credit the people on this episode

  3. Kodsnack 727 - Entropi på servern, med Jeremiah Foster

    Nov 3, 202641 minAudio

    Fredrik och Jeremiah Foster snackar e-post. Från utmaningar med att driva sin egen e-postserver till vidareutveckling av underliggande protokoll. Jeremiah vet vad han talar om - han har bland annat satt upp ett företag...

    Credit the people on this episode

  4. Kodsnack 726 - Många single point of failure, med Ingo Junefjord

    Oct 27, 20261 hr 18 minAudio

    Fredrik och Ingo Junefjord snackar om att hålla sin egen data säker, och om hur i storföretagens grepp man är bekväm med att vara. Har du någon säkerhetskopia av viktiga filer? Dina foton? Har du mer än en kopia? Var...

    Credit the people on this episode

  5. Kodsnack 725 - Linus i andra änden, med Pierre Ossman

    Oct 20, 20261 hr 1 minAudio

    Fredrik och Pierre Ossman snackar VNC, och SD-kortläsardrivrutiner. Pierres väg in i den öppna källkodens värld var - som för många andra? - att någonting inte funkade. I hans fall var det läsning av SD-kort. Till...

    Credit the people on this episode