Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning - Zadouri, Ted; Üstün, Ahmet; Ahmadian, Arash; Ermis, Beyza; Locatelli, Acyr; Hooker, Sara (International Conference on Learning Representations, 2024)