DEPT: Decoupled Embeddings for Pre-training Language Models - Iacob, Alex; Sani, Lorenzo; Kurmanji, Meghdad; Shen, William; Qiu, Xinchi; Cai, Dongqi; Gao, Yan; Lane, Nic (International Conference on Learning Representations, 2025)