Strong Preferences Affect the Robustness of Preference Models and Value Alignment - Xu, Ziwei; Kankanhalli, Mohan (International Conference on Learning Representations, 2025)