Reward Models Inherit Value Biases from Pretraining - Christian, Brian; Thompson, Jessica; Yang, Elle Michelle; Adam, Vincent; Kirk, Hannah; Summerfield, Christopher; Dumbalska, Tsvetomira (International Conference on Learning Representations, 2026)