Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Developer Voices

Developer Voices artwork

The Open Source AI Revolution Begins Now...

Jul 5, 202348 minAudio

LLMs like ChatGPT are not just fascinating, they're becoming increasing useful in our working lives. They've graduated from novelty to valuable tool. But building those tools is still in the hands of huge companies. Or is it? In this week's episode of Developer Voices, we're learning how you can run LLMs on your own laptop, and how you can customize the system to make a tailored research assistant, a better documentation-searcher, and much more. All you need is a guide on which pieces you need, and how they fit together, and that's exactly what this week's guest - Tobi Fankhänel - is here to take us through. A leaked memo from Google recently outlined how the Big Company Advantage has almost completely eroded, and how the next wave of LLM development is going to come from the open source community. So hackers rise up - the open source AI revolution begins now! -- Kris on Twitter: https://twitter.com/krisajenkins Kris on LinkedIn: https://www.linkedin.com/in/krisjenkins/ Tobias on LinkedIn: https://www.linkedin.com/in/tobias-fankh%C3%A4nel-749712180/ Tobias’ blog: https://blog.exxample.eu LangChain: https://python.langchain.com/docs/get_started/introduction.html Embeddings: https://weaviate.io/blog/vector-embeddings-explained Vector Databases: https://en.wikipedia.org/wiki/Vector_database "We have no moat" - Google Employee on Open-source LLMs: https://www.semianalysis.com/p/google-we-have-no-moat-and-neither “Attention is all you need” - https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf Timeline since Meta open-sourced their first-gen models: https://www.semianalysis.com/i/119223672/the-timeline Run LLMs on CPU only or, since May, mix CPU and GPU usage: https://github.com/abetlen/llama-cpp-python Samantha: https://erichartford.com/meet-samantha Embedding model leaderboards: https://huggingface.co/spaces/mteb/leaderboard Open-source LLMs: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard LLaMA: https://ai.facebook.com/blog/large-language-model-llama-meta-ai/ Blog post: Design-pattern ‘In-context learning’ https://a16z.com/2023/06/20/emerging-architectures-for-llm-applications/#section--2 Tobi's GitHub branch ‘In-context learning with LangChain’ https://github.com/aviav/turmbauten/blob/spaghetti-code/CHANGELOG.md Prompt Syntax Cheat Sheet: https://github.com/oobabooga/text-generation-webui/tree/main/characters/instruction-following Google Workspace Labs Sign-Up: https://workspace.google.com/labs-sign-up/ GMail Workspace Labs Demo Video, click ‘See it in action’: https://workspace.google.com/solutions/ai/#m10 Prediction trading on open-source LLMs vs GPT-4: https://manifold.markets/PeterWildeford/will-i-peter-wildeford-think-that-t-c95ff3c1b385

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Why Lisp Thrives In The Age Of AI (with Cameron Barré)

    Nov 11, 20261 hr 40 minAudio

    Earlier this year it looked like AI might kill programming language innovation. Coding agents were at their best in the mainstream languages with decades of training data, which made the barrier to adopting anything new...

    Credit the people on this episode

  2. How Would You Type-Check 30 Million Lines of PHP? (with Julien Verlaguet)

    Sep 25, 20262 hr 22 minAudio

    How would you manage 30 million lines of PHP? You can't rewrite it - you'd be fired long before you delivered. That was the problem facing Facebook around 2011, and their answer was to add a type system, giving birth to...

    Credit the people on this episode

  3. DuckDB And The Burden of Success (with Hannes Mühleisen)

    Aug 26, 20261 hr 46 minAudio

    Building something people actually want is supposed to be the happy ending. But it arrives with a bill attached: feature requests you didn't ask for, pull requests you'd rather not maintain forever, users demanding the...

    Credit the people on this episode

  4. The Enterprise AI Gap (with James Brown)

    Aug 12, 20261 hr 2 minAudio

    My guest this week is James Brown, an engineering lead at Schroders, and that's a useful vantage point - asset managers carry all the regulation and organisational weight of a bank, mixed with the first-to-market...

    Credit the people on this episode

  5. What If Every SQL Query Could Update Incrementally? (with Lalith Suresh)

    Jul 8, 20261 hr 5 minAudio

    There's a problem that's bugged the database industry since the 1980s: you run an expensive query over millions of rows, cache the result, and then a single new row arrives. Logically that's one small update, but most...

    Credit the people on this episode