Local GenAI LLMs with Ollama and Docker

DevOps and Docker Talk: Cloud Native Interviews and Tooling

Bret Fisher에서 제공하는 콘텐츠입니다. 에피소드, 그래픽, 팟캐스트 설명을 포함한 모든 팟캐스트 콘텐츠는 Bret Fisher 또는 해당 팟캐스트 플랫폼 파트너가 직접 업로드하고 제공합니다. 누군가가 귀하의 허락 없이 귀하의 저작물을 사용하고 있다고 생각되는 경우 여기에 설명된 절차를 따르실 수 있습니다 https://ko.player.fm/legal.

5M ago 50:08

MP3•에피소드 홈

Bret and Nirmal are joined by friend of the show, Matt Williams, to learn how to run your own local ChatGPT clone and GitHub Copilot clone with Ollama and Docker's "GenAI Stack," to build apps on top of open source LLMs.

We've designed this conversation for tech people like myself, who are no strangers to using LLMs in web products like chat GPT, but are curious about running open source generative AI models locally and how they might set up their Docker environment to develop things on top of these open source LLMs.

Matt Williams is walking us through all the parts of this solution, and with detailed explanations, shows us how Ollama can make it easier on Mac, Windows, and Linux to set up LLM stacks.

Be sure to check out the video version of this episode for any demos.

This episode is from our YouTube Live show on April 18, 2024 (Stream 262).

★Topics★

Creators & Guests

Cristi Cotovan - Editor
Beth Fisher - Producer
Bret Fisher - Host
Matt Williams - Host
Nirmal Mehta - Host

(00:00) - Intro
(01:32) - Understanding LLMs and Ollama
(03:16) - Ollama's Elevator Pitch
(08:40) - Installing and Extending Ollama
(17:17) - HuggingFace and Other Libraries
(19:24) - Which Model Should You Use?
(26:28) - Ollama and Its Applications
(28:57) - Retrieval Augmented Generation (RAG)
(36:44) - Deploying Models and API Endpoints
(40:38) - DockerCon Keynote and LLM Demo
(47:44) - Getting Started with Ollama

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

173 에피소드