Player FM 앱으로 오프라인으로 전환하세요!
4 - Help! There is no ground truth
저장한 시리즈 ("피드 비활성화" status)
When? This feed was archived on February 27, 2024 11:13 (). Last successful fetch was on November 09, 2024 16:14 ()
Why? 피드 비활성화 status. 잠시 서버에 문제가 발생해 팟캐스트를 불러오지 못합니다.
What now? You might be able to find a more up-to-date version using the search function. This series will no longer be checked for updates. If you believe this to be in error, please check if the publisher's feed link below is valid and contact support to request the feed be restored or if you have any other concerns about this.
Manage episode 281347136 series 2848277
Why you can't only rely on existing methods to evaluate your work, what to do when you don't have evaluation data, what to do when there is no ground truth, why some mistakes are much more important than others, and the importance of ongoing evaluations.
BTW, if you are not a data scientist yet, but want to become one, you should really attend our webinar. We will demystify the transition into data science. We will show you the most effective way to build your skills. And we will advise you on the four possible options you can take to go from where you are to landing a data science job in as little as 9 months. Find out more here.
챕터
1. 4 - Help! There is no ground truth (00:00:00)
2. How do you know when you have solved a problem (00:01:17)
3. Why you shouldn't only rely on existing e valuation methods (00:01:55)
4. Under-estimating the importance and effort of evaluation (00:02:42)
5. The gap between offline evaluation metrics and business impact (00:04:02)
6. Not all mistakes are equal (00:04:37)
7. Help! I don't have evaluation data (00:05:09)
8. Please ask for money (00:06:28)
9. Why don't you just evaluate online (00:07:59)
10. Help! There is no ground truth (00:09:48)
11. Forget about existing metrics. Find the most embarrassing data (00:12:38)
12. One-shot vs. ongoing evaluation (00:13:52)
13. The system you build doesn't exist in isolation (00:14:38)
14. The one practical thing (00:16:18)
35 에피소드
저장한 시리즈 ("피드 비활성화" status)
When? This feed was archived on February 27, 2024 11:13 (). Last successful fetch was on November 09, 2024 16:14 ()
Why? 피드 비활성화 status. 잠시 서버에 문제가 발생해 팟캐스트를 불러오지 못합니다.
What now? You might be able to find a more up-to-date version using the search function. This series will no longer be checked for updates. If you believe this to be in error, please check if the publisher's feed link below is valid and contact support to request the feed be restored or if you have any other concerns about this.
Manage episode 281347136 series 2848277
Why you can't only rely on existing methods to evaluate your work, what to do when you don't have evaluation data, what to do when there is no ground truth, why some mistakes are much more important than others, and the importance of ongoing evaluations.
BTW, if you are not a data scientist yet, but want to become one, you should really attend our webinar. We will demystify the transition into data science. We will show you the most effective way to build your skills. And we will advise you on the four possible options you can take to go from where you are to landing a data science job in as little as 9 months. Find out more here.
챕터
1. 4 - Help! There is no ground truth (00:00:00)
2. How do you know when you have solved a problem (00:01:17)
3. Why you shouldn't only rely on existing e valuation methods (00:01:55)
4. Under-estimating the importance and effort of evaluation (00:02:42)
5. The gap between offline evaluation metrics and business impact (00:04:02)
6. Not all mistakes are equal (00:04:37)
7. Help! I don't have evaluation data (00:05:09)
8. Please ask for money (00:06:28)
9. Why don't you just evaluate online (00:07:59)
10. Help! There is no ground truth (00:09:48)
11. Forget about existing metrics. Find the most embarrassing data (00:12:38)
12. One-shot vs. ongoing evaluation (00:13:52)
13. The system you build doesn't exist in isolation (00:14:38)
14. The one practical thing (00:16:18)
35 에피소드
모든 에피소드
×플레이어 FM에 오신것을 환영합니다!
플레이어 FM은 웹에서 고품질 팟캐스트를 검색하여 지금 바로 즐길 수 있도록 합니다. 최고의 팟캐스트 앱이며 Android, iPhone 및 웹에서도 작동합니다. 장치 간 구독 동기화를 위해 가입하세요.