Mixtures

Ask about this topic

Momentum

14 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 110

All topics
CardsList

  1. MOMAT: Mixture of Multiple Atlases for Low-Power Jailbreak Defense of Quantized LLMs

    Oct 1, 2026Boyang Li, Bingyu Shen, Weihao Hong +6Large Language Model QuantizationJailbreak Success Rates

    Department of Computer Science, Kean University, 1000 Morris Ave, Union, 07083, NJ, USA · Department of Computer Science and Engineering, University of Notre Dame, 257 Fitzpatrick Hall of Engineering, Notre Dame, 46556, IN, USA · McGill University, 845 Sherbrooke Street, Montréal, H3A 0G4, Québec, Canada +2

  2. Mixture of Decoders for Diverse Dialog Response Generation

    Sep 30, 2026Wenchao DuConditional Variational AutoencoderDiversity

    Microsoft Corporation Redmond, WA 98052

  3. From Task Mixtures to Specialized Experts

    Sep 30, 2026Hojat Allah Salehi, Mehrdad Mahdavi, Andrew Arash Mahyari +1Federated LearningHeterogeneity

    Florida International University, Miami, FL, USA · Security, Optimization, and Learning for InterDependent networks laboratory (solid lab), Miami, FL, USA · The Pennsylvania State University, University Park, PA, USA +1

  4. Scaling Laws for Looped Mixture of Experts

    Sep 30, 2026Yanbei Chen, Anirudh Goyal, Raghuraman KrishnamoorthiMixture-Of-ExpertsScaling Laws

    Meta AI

  5. A helps B while B hurts A: directed transfer in instruction-tuning mixture

    Sep 30, 2026Nima H. Siboni, Vahid RostamiInstruction TuningMixtures

    Juna.ai, Kastanienallee 32, 10435 Berlin, Germany · Computational Systems Neuroscience, Institute of Zoology, University of Cologne, Germany

  6. UniAE-MoE: A Unified Audio Encoder via Mixture of Experts

    Sep 30, 2026Shengbo Cai, Zhisheng Zhang, Zichao Nie +3Large Audio Language ModelsOpencode

    Tsinghua University, China

  7. QuanVI: Score-based Variational Inference via Quantum Maximally Mixed States

    Sep 30, 2026Yuchen Cong, Zerui Tao, Chao Li +2Variational Quantum AlgorithmsVariational Inference

    Juntendo University · RIKEN-AIP

  8. DCM-SAM: Defect-Conditioned Mixture of LoRA Experts for NPU-Deployed AM Defect Segmentation

    Sep 30, 2026Md Mushfiqur Rahaman, Md Mahedi Hasan, Imtiaz Ahmed +1Defect DetectionSlices

    Department of Industrial and Management Systems Engineering West Virginia University, Morgantown, WV · School of Mathematical and Data Sciences West Virginia University, Morgantown, WV · Lane Department of Computer Science & Electrical Engineering West Virginia University, Morgantown, WV

  9. Emergent Specialization in Populations of Self-Supervised Collaborative Vision Experts Without a Shared Gate or Cross-Agent Gradients

    Sep 29, 2026Aram Davtyan, Pablo Acuaviva, Sebastian Stapf +1Decentralized LearningPretraining

    u b University of Bern Computer Vision Group, Institute of Computer Science University of Bern, Switzerland

  10. MoRE: Scaling mixture of experts with hardware-aware low-rank routing

    Sep 28, 2026Honam Wong, Surbhi Goel, Enric Boix-AdseràExpertsLarge Language Model Routing

    University of Pennsylvania · The Wharton School, University of Pennsylvania

  11. HARMONIA: Interpretable Graph Learning through Mixtures of Neural Bases

    Sep 27, 2026Quan D. Bui, Nguyen Do, An Nguyen Dang +3Graph Representation LearningGeneralized Linear Model

    Center for AI Research, VinUniversity, Hanoi, Vietnam · University of Florida, Gainesville, USA · Posts and Telecommunications Institute of Technology, Hanoi, Vietnam +1

  12. MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification

    Sep 21, 2026Yu Zheng, Jinghan Peng, ChangHao Zhang +2SpeakerCnn-Transformer Tradeoff

    Machine Intelligence, Ant Group, Shanghai, China

  13. MoRE: Mixture of Reused Experts

    Sep 16, 2026Eric S. Qiu, Utku Umur Acikalin, Justin Lovelace +4Mixture-Of-ExpertsExperts

    Department of Computer Science, Cornell University

  14. Decoding Mixture Perception through Computational Modeling of Component Interactions

    Sep 14, 2026Fei Wang, Xiaoya Xie, Junfei Liu +6SmellsPerception

    College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310012, China · College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China

  15. The Dynamics of Continuous Mixture Collapse in Language Models

    Sep 2, 2026Ali BackourLarge Language Models FailLatent States

    Massachusetts Institute of Technology Cambridge, MA 02139

  16. When Can We Work in Embedding Space? What Text Embeddings Preserve

    Aug 31, 2026Simon FreyaldenhovenText EmbeddingsText Analysis and Detection

    Federal Reserve Bank of Philadelphia

  17. Structure Aware Neural Architecture Search for Mixture of Experts

    Aug 30, 2026Petr Babkin, Oleg BakhteevMixture-Of-Experts ArchitecturesNeural Architecture Search

  18. MoPLEx: Estimating Plackett-Luce Mixture Models for Multi-Objective Alignment

    Aug 25, 2026Dongyue Li, Ziniu Zhang, Lu Wang +1Preference AlignmentMixture Models

    Northeastern University, Boston, MA · University of Michigan, Ann Arbor, MI

  19. Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model

    Aug 13, 2026Mohammed Sabry, Sean Augenstein, Keith Rush +1Large Language Model PretrainingPretraining

    Google, Mountain View, CA, USA · School of Computing, Dublin City University, Dublin, Ireland.

  20. MammoMix: Leveraging Mixture of Experts for Robust Mammogram Breast Detection

    Aug 11, 2026Dinh Tan Nguyen, Hoang Quan Dang, Chen Zhang +1MammographyMixture-Of-Experts

    School of Biomedical Engineering, University of Technology Sydney · School of Computer Science, University of Technology Sydney · School of Electrical and Data Engineering, University of Technology Sydney

  21. MixFormer: Linear Transformer with Mixture of Memory Experts

    Aug 10, 2026Yu Guo, Lei DuanKimi Delta AttentionEfficient Long-Context Inference

    School of Computer Science, Sichuan University Chengdu, China · School of Artificial Intelligence, Sichuan University Chengdu, China

  22. MoRSE: Task-Oriented Multi-Agent System with Mixture of Role-Subtask Experts

    Aug 10, 2026Peiwen Li, Shiyang Zhang, Yangtian Zhang +3Model-Based Multi-Agent SystemsTask-Level

    Yale University, New Haven, CT, USA

  23. Mixture of Geodesic Factor Analyzers on Riemannian Homogeneous Spaces

    Aug 7, 2026Hengchao Chen, Yuanyao Tan, Chao Huang +2Gaussian Mixture ModelsRiemannian Manifolds

    University of Toronto · Florida State University · Eli Lilly and Company +3

  24. Symbolic Machine Learning for Vapor-Liquid Equilibrium Prediction in Cx-N2 Binary Mixtures

    Aug 6, 2026Bongseok Kim, Suman Chakraborty, Gary Huang +3Molecular Property PredictionDeep Learning

    Purdue University, School of Mechanical Engineering, 47906, IN, United States · Purdue University, School of Aeronautics and Astronautics, 47906, IN, United States · Purdue University, Department of Mathematics, 47906, IN, United States

  25. Uncertainty Is Not Enough: Value-of-Information Routing for Mixtures of LoRA Experts

    Aug 3, 2026Tom Saliencro, Rohan Desai, Priya Nair +2ExpertsMixtures

    University of California, Irvine · University of Washington

  26. MoCRA: Mixture of Compositional Rank-1 Atoms for 4K All-in-One Video Restoration

    Aug 3, 2026Yongcong Wang, Pu Wang, Hingchin Chen +8Video RestorationVideo Quality

    1Central South University · 2Shandong University · 3Shenzhen Loop Area Institute +8

  27. Measuring in-context algorithmic reasoning in language models against an exact Bayes-optimal standard

    Aug 3, 2026Hector Zenil, Luan OzelimInductionCounter Turing Test

    Oxford Immune Algorithmics, Oxford University Innovation & London Institute for Healthcare Engineering, U.K · Department of Biomedical Computing, School of Biomedical Engineering and Imaging Sciences & King’s Institute for AI, King’s College London, U.K

  28. Multiclass Classification without Labels via Posterior Simplex Geometry

    Jul 27, 2026Raphaël Bonnet-Guerrini, Johann Ioannou-Nikolaides, Troels Petersen +1Multiclass ClassificationUnlabeled Data

    Niels Bohr Institute University of Copenhagen Copenhagen, 2100 · Computer Science Department Università degli Studi di Milano Milan, MI, 20133

  29. PYPM-GGD: Pitman-Yor Process Mixture with Generalized Gaussian Density using ADAM

    Jul 27, 2026Kart-Leong LimVariational InferenceAdam

    Institute of Microelectronics, A*Star Singapore

  30. MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition

    Jul 27, 2026Sangmin Lee, Woojin Chung, Woongjib Choi +1Multilingual Automatic Speech RecognitionMultilingual Language Models

    Dept. of Electronics and Electrical Engineering, Yonsei University, Seoul, South Korea

  31. Beyond Predictive Accuracy: A Reliability-Aware Audit of Molecular Representations for Human Olfaction

    Jul 25, 2026Kai Lun Huang, Wei Chieh SunMolecular Representation LearningSmells

    California State University, Fullerton · Department of Electrical and Computer Engineering California State University, Fullerton Fullerton, CA, USA · University of Washington +1

  32. MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Experts

    Jul 22, 2026Huangbiao Xu, Huanqi Wu, Xiao Ke +3Open-Vocabulary Action RecognitionMixtures

    Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, College of Computer and Data Science, Fuzhou University, Fuzhou 350108, China · Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou 350108, China · School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China

  33. Mixture of Cognitive Experts in Large Vision-Language Models

    Jul 12, 2026Robert Wijaya, Ngai-Man CheungRecent Vision-Language ModelsMultimodal Reasoning

    Singapore University of Technology and Design (SUTD), Singapore

  34. Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

    Jul 9, 2026Dominick Reilly, Qiyu Wu, Hiromi Wakaki +2Multimodal Large Language ModelsModality-Specific Encoders

    Sony Group Corporation · University of North Carolina at Charlotte · Sony AI

  35. Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learning

    Jul 9, 2026Yiyang Fang, Pei Fu, Jinjie Li +7LLM Reasoning StrategiesMultimodal Large Language Models

    Wuhan University · The Hong Kong University of Science and Technology · Xiaomi Inc +2

  36. BACH: A Bayesian Admixture of Contrastive Heads for Multi-Interest Two-Tower Retrieval

    Jul 9, 2026Quoc Phong Nguyen, Paul Albert, Long Vuong +2RetrieversMixture Models

    Amazon

  37. Mixture of Enhanced-View Experts for Multi-Query Vehicle ReID and A Large-Scale Benchmark

    Jul 9, 2026Aihua Zheng, Jie Zhen, Chenglong Li +2Re-IdentificationCross-View Fusion

    Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui Provincial Key Laboratory of Multimodal Cognitive Computation, School of Artificial Intelligence, Anhui University. Hefei, 230601, China · Anhui Provincial Key Laboratory of Multimodal Cognitive Computation, School of Artificial Intelligence, Anhui University. Hefei, 230601, China · School of Artificial Intelligence, Anhui University of Science and Technology, Hefei 232001, China +1

  38. Image classification via a quantum-inspired strategy involving a mixture of experts

    Jul 8, 2026Kumari Jyoti, Rohith Babu, Apoorva D. PatelImage ClassificationQuantum Annealing

    Centre for High Energy Physics, Indian Institute of Science, Bangalore 560012

  39. Stable Global Weighting of Flow Mixtures using Simplex Exponential Moving Average

    Jul 4, 2026Benjamin Wiriyapong, Oktay Karakus, Can Eyupoglu +1Normalizing FlowsVariational Inference

    School of Computer Science and Informatics, Cardiff University, Abacws, Cardiff, CF24 4AG, U.K. · Department of Computer Engineering, Turkish Air Force Academy, National Defence University, Istanbul, Türkiye.

  40. Demonstrating Generalization Failures via Mixtures of Conditional Policies

    Jul 3, 2026Jou Barzdukas, Jack Peck, Julian Schulz +3Training-Inference MismatchMixtures

    University of Virginia · ETH Zurich · MATS +3

  41. CURE: Controllable Unified Image Restoration for Complex Degradations

    Jul 3, 2026Boseong Kim, Donghyeon ChoImage RestorationRestoration

    Department of Computer Science, Hanyang University, Seoul, South Korea

  42. MEPA: Multi-Scale Representation Alignment for Visual Autoregressive Modeling with Mixture of Experts

    Jul 1, 2026Nuoyan Zhou, Zhijun Tu, Lei Yu +4Visual Autoregressive ModelsAutoregressive Generation

    State Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, China · † This work was done during an internship at Huawei Technologies Co., Ltd. · Huawei Technologies Co., Ltd.

  43. FRAME: Learning the Adaptation Domain with a Mixture of Fractional-Fourier Experts

    Jun 30, 2026Tom Saliencro, Maya Lindqvist, Rohan Desai +2FourierExperts

    University of California, Irvine · University of Washington

  44. FaceMoE: Mixture of Experts for Low-Resolution Face Recognition

    Jun 30, 2026Kartik Narayan, Vishal M. PatelFace Recognition ModelLow-Resolution

    Johns Hopkins University

  45. Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs

    Jun 30, 2026Seyed Alireza Molavi, Zhan Su, Yan Hu +3Low-Rank Adaptation AdaptersMixture-Of-Experts Large Language Models

    1Halmstad University, Halmstad, Sweden · 2The Chinese University of Hong Kong, Shenzhen, China

  46. Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning

    Jun 28, 2026Dayong Liang, Kaisong Gong, Yi Cai +2Multi-Agent DebateDebate

    South China University of Technology · Tianjin University · The Hong Kong Polytechnic University

  47. Fisher-Routed Mixture of Experts for Federated Class-Incremental Learning

    Jun 27, 2026Wenhao Yuan, Chenchen Lin, Jian Chen +3Federated LearningClass-Incremental Learning

    Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China · School of Artificial Intelligence, Sun Yat-sen University, China.

  48. DataComp-VLM: Improved Open Datasets for Vision-Language Models

    Jun 26, 2026Matteo Farina, Vishaal Udandarao, Thao Nguyen +33Ava-VlmMultimodal Benchmarks

    University of Trento · 2Tübingen AI Center, University of Tübingen · University of Cambridge +12

  49. S2S^{2}-FracMix: Label-Preserving Self-Saliency Mixup Augmentation

    Jun 24, 2026Khawar Islam, Arif Mahmood, Xin Jin +1Data AugmentationSaliency

    The University of Melbourne, Australia · Information Technology University, Pakistan · Westlake University, China

  50. Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach

    Jun 19, 2026Tzu-Chieh Wei, Yi-Cheng Lin, Huang-Cheng Chou +4Automatic Speaker VerificationSpeaker

    University of Michigan, USA · National Taiwan University, Taipei, Taiwan · Signal Analysis and Interpretation Laboratory (SAIL), University of Southern California, USA +1

  51. Mixtures of Subspaces for Bandwidth Efficient Context Parallel Training

    Jun 15, 2026Sameera Ramasinghe, Ajanthan Thalaiyasingam, Hadi Mohaghegh Dolatabadi +5Large Language Model CompressionEfficient Long-Context Inference

    Pluralis Research

  52. FastMix: Fast Data Mixture Optimization via Gradient Descent

    Jun 12, 2026Haoru Tan, Sitong Wu, Yanfeng Chen +5PretrainingEfficient Sequence Mixers

    University of Hong Kong · 2Hunyuan LLM, Tencent · 3Chinese University of Hong Kong

  53. Gaussian Mixture Attention: Linear-Time Sequence Mixing via Probabilistic Latent Routing

    Jun 9, 2026Yongchao Huang, Hassan RazaAsymmetric Grouped-Attention Variate MixerMixtures

  54. Density estimation for Hellinger via minimum-distance estimators: mixtures of Gaussians, log-concave, and more

    Jun 9, 2026Spencer Compton, Jerry LiDensity Ratio EstimationOptimal Sample Complexity

    Stanford University · University of Washington

  55. Physics-Constrained Neural Surrogate for Domain Growth Prediction in Systems with Conserved Kinetics

    Jun 9, 2026Vijay Yadav, Pallvi Pandey, Madhu Priya +2Physics-Guided Machine LearningKinetics

    Department of Physics, Indian Institute of Technology Jodhpur, Jodhpur, Rajasthan 342 030, India · Department of Physics, Birla Institute of Technology Mesra, Ranchi, Jharkhand 835 215, India · Department of Physics, Central University of Rajasthan, Ajmer, Rajasthan 305 817, India

  56. Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling

    Jun 9, 2026Guodong Lin, Ziqi Chen, Yuxiang Fu +2End-To-End Automatic Speech Recognition ModelsAutomatic Speech Recognition

    Department of Electronic Engineering, Tsinghua University, Beijing, China · Beijing Haitian Ruisheng Science Technology Ltd., China

  57. Identifiability and Estimation for Unlabeled Finite Mixtures under Marginal Independence

    Jun 6, 2026Takafumi Kanamori, Yushi Hirose, Shohei YamamotoMixture ModelsIdentifiability

    Department of Mathematical and Computing Science, Institute of Science Tokyo · RIKEN Center for Advanced Intelligence Project

  58. TANDEM: Bi-Level Data Mixture Optimization with Twin Networks

    Jun 3, 2026Jiaxing Wang, Deping Xiang, Jin Xu +9Mixture ModelsReweighting

    University of Oxford · Renmin University of China · University of Chinese Academy of Sciences

  59. MoEIoU: Rethinking Bounding-Box Regression as a Mixture of Experts

    May 30, 2026Vinay Edula, Priyanka BagadeBounding BoxObject Detection

    Department of Computer Science and Engineering Indian Institute of Technology Kanpur Kanpur, U.P, India

  60. MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation

    May 29, 2026Zheng Yuan, Chuang Zhou, Linhao Luo +4Graph-Based Retrieval Augmented GenerationExperts

    The Hong Kong Polytechnic University · Monash University · Tencent Youtu Lab