Parameter-Free Mixture-of-Experts Routing

Latest papers 10

All topics
CardsList
  1. Score the Update, Not the Token: Descent-Aligned Routing for Combinatorial LoRA Experts

    Sep 30, 2026Priya Nair, Lukas Brenner, Maya Lindqvist +5Mixture-of-Experts Language ModelsParameter-Free Mixture-of-Experts Routing

  2. Cross-Entropy Guided Routing in Mixture-of-Experts Large Language Models

    Sep 29, 2026Yury Nahshan, Nati Daniel, Jacob Goldberger +1Mixture-of-Experts Language ModelsParameter-Free Mixture-of-Experts Routing

  3. MoRE: Scaling mixture of experts with hardware-aware low-rank routing

    Sep 28, 2026Honam Wong, Surbhi Goel, Enric Boix-AdseràParameter-Free Mixture-of-Experts RoutingLow-Rank Matrix Decomposition

  4. Spend Experts Where You Are Unsure: Confidence-Adaptive Routing for Mixture-of-Experts LoRA

    Jul 28, 2026Tom Saliencro, Rohan Desai, Priya Nair +2Parameter-Free Mixture-of-Experts RoutingLLM Inference Acceleration

  5. Eigenvectors of Experts are Training-free Non-collapsing Routers

    May 29, 2026Giang Do, Hung Le, Truyen TranParameter-Free Mixture-of-Experts RoutingMixture of Experts

  6. Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts

    May 12, 2026Sagi Ahrac, Noya Hochwald, Mor GevaExpert Load BalancingParameter-Free Mixture-of-Experts Routing

  7. Self-Routing: Parameter-Free Expert Routing from Hidden States

    Apr 1, 2026Jama Hussein Mohamud, Drew Wagner, Mirco RavanelliParameter-Free Mixture-of-Experts RoutingLLM Routing