Towards Understanding Valuable Preference Data for Large Language Model Alignment - Zhang, Zizhuo; Wang, Qizhou; Ye, Shanshan; ZHU, Jianing; Yao, Jiangchao; Han, Bo; Sugiyama, Masashi (International Conference on Learning Representations, 2026)