))
Episode 12 - Leaked Google Strategy Memo, Open Source, AI Value Chains
Manage episode 407381684 series 3560533
Jeff Hwang and Seymour Duncker에서 제공하는 콘텐츠입니다. 에피소드, 그래픽, 팟캐스트 설명을 포함한 모든 팟캐스트 콘텐츠는 Jeff Hwang and Seymour Duncker 또는 해당 팟캐스트 플랫폼 파트너가 직접 업로드하고 제공합니다. 누군가가 귀하의 허락 없이 귀하의 저작물을 사용하고 있다고 생각되는 경우 여기에 설명된 절차를 따르실 수 있습니다 https://ko.player.fm/legal.
Jeff and Seymour briefly discuss Google I/O which happened last week including the release of PaLM 2. Most of the episode is spent on the strategic and ecosystem implications of an internal Google strategy memo and the impact of open source. They also discuss AI Supply Chains in the context of a series of MIT blog posts from April. Finally, they draw analogies from earlier eras of tech history including the rise of the PC industry and IBM/Oracle's relationship with Linux in the late 20th century. Links:
- Jordan Burgess pushes back on Google strategy memo
- Andrej Karpathy's perspective
- Andrej's overall view of current LLM landscape which is similar to Jeff and Seymour's four part framework of understanding gen AI: (1) pre-trained foundation model; (2) fine-tuning; (3) whole product / end user UX; and (4) distribution
- Examples of fine-tuning methods: (1) RHLF; (2) LoRA; (3) LLaMA Adaptor
- Explanation of quantization to make foundation models lighter weight
Send questions/comments to stepfunctionpod@gmail.com and find us on the web at www.stepfunction.org
19 에피소드
공유
