Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling - Xu, Wenda; Han, Rujun; Wang, Zifeng; Le, Long; Madeka, Dhruv; Li, Lei; Wang, William; Agarwal, Rishabh; Lee, Chen-Yu; Pfister, Tomas (International Conference on Learning Representations, 2025)