Player FM 앱으로 오프라인으로 전환하세요!
The server-side rendering equivalent for LLM inference workloads
Manage episode 501111517 series 1123725
Ryan is joined by Tuhin Srivastava, CEO and co-founder of Baseten, to explore the evolving landscape of AI infrastructure and inference workloads, how the shift from traditional machine learning models to large-scale neural networks has made GPU usage challenging, and the potential future of hardware-specific optimizations in AI.
Episode notes:
Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring AI products to market fast.
Connect with Tuhin on LinkedIn or reach him at his email [email protected].
Shoutout to user Hitesh for winning a Populist badge for their answer to Cannot drop database because it is currently in use.
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
861 에피소드
Manage episode 501111517 series 1123725
Ryan is joined by Tuhin Srivastava, CEO and co-founder of Baseten, to explore the evolving landscape of AI infrastructure and inference workloads, how the shift from traditional machine learning models to large-scale neural networks has made GPU usage challenging, and the potential future of hardware-specific optimizations in AI.
Episode notes:
Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring AI products to market fast.
Connect with Tuhin on LinkedIn or reach him at his email [email protected].
Shoutout to user Hitesh for winning a Populist badge for their answer to Cannot drop database because it is currently in use.
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
861 에피소드
모든 에피소드
×플레이어 FM에 오신것을 환영합니다!
플레이어 FM은 웹에서 고품질 팟캐스트를 검색하여 지금 바로 즐길 수 있도록 합니다. 최고의 팟캐스트 앱이며 Android, iPhone 및 웹에서도 작동합니다. 장치 간 구독 동기화를 위해 가입하세요.