Weak-to-Strong Preference Optimization: Stealing Reward from Weak Aligned Model - Zhu, Wenhong; He, Zhiwei; Wang, Xiaofeng; Liu, Pengfei; Wang, Rui (International Conference on Learning Representations, 2025)