Compositional Preference Models for Aligning LMs - GO, DONGYOUNG; Korbak, Tomek; Kruszewski, Germàn; Rozen, Jos; Dymetman, Marc (International Conference on Learning Representations, 2024)