FSPO: Few-Shot Optimization of Synthetic Preferences Effectively Personalizes to Real Users - Singh, Anikait; Hsu, Sheryl; Hsu, Kyle; Mitchell, Eric; Ermon, Stefano; Hashimoto, Tatsunori; Sharma, Archit; Finn, Chelsea (International Conference on Learning Representations, 2026)