Human Feedback is not Gold Standard - Hosking, Tom; Blunsom, Phil; Bartolo, Max (International Conference on Learning Representations, 2024)