A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglement - Yuan, Hui; Zeng, Yifan; Wu, Yue; Wang, Huazheng; Wang, Mengdi; Leqi, Liu (International Conference on Learning Representations, 2025)