Player FM 앱으로 오프라인으로 전환하세요!
LoCa: Logit Calibration for Knowledge Distillation
Manage episode 439051504 series 3524393
This paper introduces Logit Calibration (LoCa) to enhance knowledge distillation by correcting teacher model predictions while preserving valuable information, improving student model performance without extra parameters.
https://arxiv.org/abs//2409.04778
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1497 에피소드
Manage episode 439051504 series 3524393
This paper introduces Logit Calibration (LoCa) to enhance knowledge distillation by correcting teacher model predictions while preserving valuable information, improving student model performance without extra parameters.
https://arxiv.org/abs//2409.04778
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1497 에피소드
모든 에피소드
×플레이어 FM에 오신것을 환영합니다!
플레이어 FM은 웹에서 고품질 팟캐스트를 검색하여 지금 바로 즐길 수 있도록 합니다. 최고의 팟캐스트 앱이며 Android, iPhone 및 웹에서도 작동합니다. 장치 간 구독 동기화를 위해 가입하세요.