))
Keeping it Local: Generative AI at the Edge
Manage episode 497201450 series 3646678
Kyle Dando에서 제공하는 콘텐츠입니다. 에피소드, 그래픽, 팟캐스트 설명을 포함한 모든 팟캐스트 콘텐츠는 Kyle Dando 또는 해당 팟캐스트 플랫폼 파트너가 직접 업로드하고 제공합니다. 누군가가 귀하의 허락 없이 귀하의 저작물을 사용하고 있다고 생각되는 경우 여기에 설명된 절차를 따르실 수 있습니다 https://ko.player.fm/legal.
Unlocking AI at the Edge with NXP's eIQ GenAI Flow | EdgeVerse Techcast
In this episode of the EdgeVerse Techcast, hosts Bridgette Stone and Kyle Dando delve into the transformative impact of NXP's eIQ GenAI Flow on edge computing. Joined by AI expert Davis Sawyer, the conversation covers the deployment of large language models at the edge, the integration of audio tasks, and the role of Retrieval Augmented Generation (RAG) in improving model accuracy. The discussion also highlights real-world applications in automotive, healthcare, and industrial automation, showcasing how eIQ GenAI Flow enables secure, efficient, and local AI processing.
Tune in to discover how this innovative tool is setting new standards for AI performance at the edge.
Additional resources to keep learning:
- eIQ on NXP.com: www.nxp.com/eIQ
- Read a Blog: www.nxp.com/company/about-nxp/smarter-world-blog/BL-GEN-AI-FOR-EMBEDDED-APPS
- Read a Paper: www.nxp.com/webapp/Download?colCode=GEN-AI-RAG-WHITEPAPER
- Watch Training: www.nxp.com/design/design-center/training/TS-MACHINE-LEARNING-AND-AI
00:00 Introduction and Hosts
00:53 Guest Introduction: Davis Sawyer
01:39 Understanding eIQ GenAI Flow
03:06 Exploring RAG (Retrieval Augmented Generation)
05:44 Quantization and NPU Acceleration
08:08 Real-World Applications of GenAI Flow
10:17 Future of Edge-Based GenAI
12:01 Conclusion and Wrap-Up
34 에피소드
공유
