Attention with Markov: A Curious Case of Single-layer Transformers - Makkuva, Ashok; Bondaschi, Marco; Girish, Adway; Nagle, Alliot; Jaggi, Martin; Kim, Hyeji; Gastpar, Michael (International Conference on Learning Representations, 2025)