When Weak LLMs Speak with Confidence, Preference Alignment Gets Stronger - Afzali, Amirabbas; Jeon, Myeongho; Brbic, Maria (International Conference on Learning Representations, 2026)