Randomization Boosts KV Caching, Learning Balances Query Load: A Joint Perspective - Wu, Fangzhou; Silwal, Sandeep; Zhang, Qiuyi (Richard) (International Conference on Learning Representations, 2026)