Player FM 앱으로 오프라인으로 전환하세요!
Chatbot and LLM Analytics with Eric Griffing
Manage episode 417460809 series 2093893
From the granular details of measuring intent and LLM-based chatbot effectiveness to the strategic implementation of AI across business units, Eric provides an in-depth analysis on the importance of data-driven decisions in the era of AI transformation.
Join us as we discuss how businesses can leverage analytics to optimise customer interactions, the common pitfalls in current AI strategies, and the future of AI in customer service.
In this episode
00:00 Introduction and UNPARSED conference - Find out more at https://unparsedconf.com
4:32 Welcom Eric Griffing
7:25 Best practice for measuring LLM agents
12:10 Differences tracking ML and LLM bots
14:00 Goal completion
19:00 What's missing
22:00 How to set up tracking on chatbots
24:50 Tracking LLM chatbots
30:37 Air Canada's chatbot issues
33:38 LLM guardrails
37:00 Using data to inform your AI strategy
41:00 Effort over satisfaction
44:30 Tracking customer effort in chatbots
48:40 Market demand for AI analytics
55:40 Wrap up
Subscribe to https://vux.world/subscribe for weekly updates on how to implement AI effectively in your organisation.
Learn more from Dashbot:
https://www.dashbot.io/blog/360-bot-framework
https://www.dashbot.io/blog/inside-the-black-box-analyzing-your-llm-bot
https://www.dashbot.io/blog/navigating-the-shift-from-intent-based-to-language-model-chatbots
Unparsed, the world's most loved conversational AI conference returns with more punch, more passion and more impact! Buy your tickets now here
Hosted on Acast. See acast.com/privacy for more information.
320 에피소드
Manage episode 417460809 series 2093893
From the granular details of measuring intent and LLM-based chatbot effectiveness to the strategic implementation of AI across business units, Eric provides an in-depth analysis on the importance of data-driven decisions in the era of AI transformation.
Join us as we discuss how businesses can leverage analytics to optimise customer interactions, the common pitfalls in current AI strategies, and the future of AI in customer service.
In this episode
00:00 Introduction and UNPARSED conference - Find out more at https://unparsedconf.com
4:32 Welcom Eric Griffing
7:25 Best practice for measuring LLM agents
12:10 Differences tracking ML and LLM bots
14:00 Goal completion
19:00 What's missing
22:00 How to set up tracking on chatbots
24:50 Tracking LLM chatbots
30:37 Air Canada's chatbot issues
33:38 LLM guardrails
37:00 Using data to inform your AI strategy
41:00 Effort over satisfaction
44:30 Tracking customer effort in chatbots
48:40 Market demand for AI analytics
55:40 Wrap up
Subscribe to https://vux.world/subscribe for weekly updates on how to implement AI effectively in your organisation.
Learn more from Dashbot:
https://www.dashbot.io/blog/360-bot-framework
https://www.dashbot.io/blog/inside-the-black-box-analyzing-your-llm-bot
https://www.dashbot.io/blog/navigating-the-shift-from-intent-based-to-language-model-chatbots
Unparsed, the world's most loved conversational AI conference returns with more punch, more passion and more impact! Buy your tickets now here
Hosted on Acast. See acast.com/privacy for more information.
320 에피소드
Todos os episódios
×플레이어 FM에 오신것을 환영합니다!
플레이어 FM은 웹에서 고품질 팟캐스트를 검색하여 지금 바로 즐길 수 있도록 합니다. 최고의 팟캐스트 앱이며 Android, iPhone 및 웹에서도 작동합니다. 장치 간 구독 동기화를 위해 가입하세요.