¡Desconecta con la aplicación Player FM !
[QA] LoCa: Logit Calibration for Knowledge Distillation
Manage episode 439051503 series 3524393
This paper introduces Logit Calibration (LoCa) to enhance knowledge distillation by correcting teacher model predictions while preserving valuable information, improving student model performance without extra parameters.
https://arxiv.org/abs//2409.04778
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1497 episodios
Manage episode 439051503 series 3524393
This paper introduces Logit Calibration (LoCa) to enhance knowledge distillation by correcting teacher model predictions while preserving valuable information, improving student model performance without extra parameters.
https://arxiv.org/abs//2409.04778
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1497 episodios
सभी एपिसोड
×Bienvenido a Player FM!
Player FM está escaneando la web en busca de podcasts de alta calidad para que los disfrutes en este momento. Es la mejor aplicación de podcast y funciona en Android, iPhone y la web. Regístrate para sincronizar suscripciones a través de dispositivos.