Hybrid Mamba-Transformer Architectures

Ask about this topic

Latest papers

CardsList

19 papers3 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

  1. TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory

    Oct 14, 2026Hanxin ZhangHybrid Transformer-State Space Model ArchitecturesAutoregressive Language Modeling

    Department of Neurology, University of Pittsburgh

  2. Learning Rate Transfer for Hybrid Transformer-SSM Architectures

    Oct 1, 2026Jimin Seo, Gyubok Lee, Yeonsik Jo +11Hyperparameter TransferHybrid Transformer-State Space Model Architectures

    Seoul National University · SB Intuitions · LG AI Research +1

  3. MambaVoice: Lightweight Audiovisual Singing Voice Separation Via A Hybrid Mamba-Transformer Model

    Sep 22, 2026Adithi Shankar, Gopika Krishnan, Gloria Haro +2Hybrid Mamba-Transformer ArchitecturesAudio Source Separation

    Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain · Intelligent Multimodal Vision Analysis Group, Universitat Pompeu Fabra, Barcelona, Spain · Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona, Spain

  4. HYDRA: A Heterogeneous Chiplet DSE Framework for Serving Dynamic Hybrid LLM Workloads

    Aug 19, 2026Jiahao Lin, Alish Kanani, Sangwan Lee +2Hybrid Mamba-Transformer ArchitecturesLLM Serving

    University of Wisconsin–Madison · University of Ulsan

  5. A Sovereign, Open-Source Foundation Model for German and English

    Jul 10, 2026The Soofi-Team, :, Benedikt Droste +29Language Model PretrainingMultilingual Language Models

    ellamind · Fraunhofer IAIS · Lamarr +8

  6. Training Hybrid Block Diffusion Language Models with Partial Bidirectionality

    Jul 2, 2026Pranshu Chaturvedi, Parth Shroff, Tarun Suresh +2Blockwise Diffusion Language ModelsDiffusion Language Models

    Stanford University

  7. Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

    Jun 12, 2026NVIDIA, :, Aaron Blakeman +571Mixture-of-Experts Language ModelsLong-Context Language Model Inference

    Allan

  8. Forget Attention: Importance-Aware Attention Is All You Need

    Jun 1, 2026Suhyeong Shin, Yeongwook YangSoftmax AttentionLong-Context Language Modeling

    Department of Computer Engineering Kangwon National University

  9. Zamba2-VL Technical Report

    May 29, 2026Hassan Shapourian, Kasra Hejazi, Olabode M. Sule +1Vision-Language ModelsEfficient VLM Inference

    Zyphra, San Francisco, CA

  10. Priming: Hybrid State Space Models From Pre-trained Transformers

    May 8, 2026Aditya Chattopadhyay, Elvis Nunez, Prannay Kaul +6State Space ModelsLong-Context Language Model Inference

    AWS Agentic AI

  11. QHyer: Q-conditioned Hybrid Attention-mamba Transformer for Offline Goal-conditioned RL

    May 3, 2026Xing Lei, Jincheng Wang, Xuetao Zhang +1Hybrid Mamba-Transformer ArchitecturesOffline RL

    National Key Laboratory of Human-Machine Hybrid Augmented Intelligence and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · Computer Science, University College London · School of Engineering, Westlake University

  12. Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

    Apr 14, 2026NVIDIA, :, Aakshita Chandiramani +544Hybrid Transformer-State Space Model ArchitecturesMixture-of-Experts Language Models

  13. HELIX: Scaling Raw Audio Understanding with Hybrid Mamba-Attention Beyond the Quadratic Limit

    Mar 22, 2026Khushiyant, Param ThakkarAudio Representation LearningHybrid Mamba-Transformer Architectures

    Department of Computer Science, University of Freiburg, Freiburg im Breisgau, Germany · Department of Computer Engineering and Information Technology, Veermata Jijabai Technological Institute, Mumbai, India

  14. InfoMamba: An Attention-Free Hybrid Mamba-Transformer Model

    Mar 8, 2026Youjin Wang, Jiaqiao Zhao, Rong Fu +5Hybrid Mamba-Transformer ArchitecturesHybrid Transformer-State Space Model Architectures

    Renmin University of China, Beijing, China · University of Macau, Macau SAR, China · Central South University, Changsha, China +1

  15. MaBERT:A Padding Safe Interleaved Transformer Mamba Hybrid Encoder for Efficient Extended Context Masked Language Modeling

    Mar 3, 2026Jinwoong Kim, Sangjin ParkHybrid Transformer-State Space Model ArchitecturesLong-Context Language Modeling

    Graduate School of Industrial Data Engineering, Hanyang University, Seoul, Republic of Korea

  16. Efficient Extractive Summarization with MAMBA-Transformer Hybrids for Low-Resource Scenarios

    Mar 1, 2026Nisrine Ait KhayiHybrid Transformer-State Space Model ArchitecturesText Summarization

    Independent Researcher · University of Memphis

  17. VP-Hype: A Hybrid Mamba-Transformer Framework with Visual-Textual Prompting for Hyperspectral Image Classification

    Mar 1, 2026Abdellah Zakaria Sellam, Fadi Abdeladhim Zidi, Salah Eddine Bekhouche +4Hybrid Mamba-Transformer ArchitecturesHyperspectral Image Classification

    Institute of Applied Sciences and Intelligent Systems (ISASI), CNR, 73100 Lecce, Italy · Dept. of Engineering for Innovation, University of Salento, 73100 Lecce, Italy · VSC Laboratory, Department of Electronics and Automation, University of Biskra, Biskra, Algeria +4

  18. Stateful Token Reduction for Long-Video Hybrid VLMs

    Feb 27, 2026Jindong Jiang, Amala Sanjay Deshmukh, Kateryna Chumachenko +7Hybrid Mamba-Transformer ArchitecturesEfficient VLM Inference

    NVIDIA

  19. HyMaTE: A Hybrid Mamba and Transformer Model for EHR Representation Learning

    Sep 28, 2025Md Mozaharul Mottalib, Thao-Ly T. Phan, Rahmatollah BeheshtiRepresentation LearningHybrid Mamba-Transformer Architectures

    University of Delaware Newark, Delaware, USA · Thomas Jefferson University & Nemours Children’s Health Wilmington, Delaware, USA