Hybrid Mamba-Transformer Model

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21

Latest papers 22

All topics

Physics and Data Driven Transformer-Mamba Framework for Flow Field
Sep 24, 2026Zhuo Zhang, Shun Zou, Canqun Yang +1Computational Fluid Dynamic Partial Differential Equations
College of Computer Science and Technology, National University of Defense Technology, Changsha, China · College of Artificial Intelligence, Nanjing Agricultural University, NanJing, China · National SuperComputer Center in Tianjin, Binhai New Area, Tianjin, China +1
MambaVoice: Lightweight Audiovisual Singing Voice Separation Via A Hybrid Mamba-Transformer Model
Sep 22, 2026Adithi Shankar, Gopika Krishnan, Gloria Haro +2Speech Separation Hybrid Mamba-Transformer Model
Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain · Intelligent Multimodal Vision Analysis Group, Universitat Pompeu Fabra, Barcelona, Spain · Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona, Spain
SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models
Sep 21, 2026Ali Kerem Bozkurt, Baris Cem Bakay, Ibrahim Kulac +3Whole-Slide Images Pathology Foundation Models
Kocı University, Department of Computer Engineering · Kocı University, Department of Pathology · Hacettepe University, Department of Artificial Intelligence and Data Engineering
Motif 3: Technical Report
Aug 10, 2026Junghwan Lim, Joon Son Chung, Sungmin Lee +24Mixture-Of-Experts Large Language Models Hybrid Mamba-Transformer Model
Motif Technologies
AraSSM: A bidirectional state-space encoder for Arabic masked language modeling
Aug 8, 2026Ahmed Amine Aliane, Hassina Aliane, Nasredine SemmarArabic Natural Language Processing Hybrid Mamba-Transformer Model
Arabic Institute for Translation, Algiers, Algeria · CERIST, Algeria · CEA LIST, Paris-Saclay, France
Morphology Aware Reversible Semantic Tokenization and Hierarchical Word Composition for Tamil Language Models
Aug 2, 2026Anand MuruganSubword Tokenization Morphology
Multi-level context Modeling for consistent expert selection in Mixture-of-Experts
Jul 17, 2026Shuhan Huang, Naifan Zhang, Yuanbo Tang +2Hybrid Mamba-Transformer Model Transformer Architectures
Tsinghua Shenzhen International Graduate School, Tsinghua University · School of AI, The Chinese University of Hong Kong (Shenzhen)
Full-Pipeline Inference Optimization for MiMo-V2.5 Series: Pushing Hybrid SWA Efficiency to the Limit
Jul 14, 2026Xiaomi MiMo Team, Anqi Liu, Aoxin Ma +28Fast Inference Hybrid Mamba-Transformer Model
MiMo Team, Xiaomi
CHASE: Cache-Hole-Adapted Skip Exit for Looped State-Space Language Models
Jul 11, 2026Zhenxuan Yu, Takeshi Kojima, Yutaka Matsuo +1Hybrid Mamba-Transformer Model Recurrence
Rikkyo University · The University of Tokyo
A Sovereign, Open-Source Foundation Model for German and English
Jul 10, 2026The Soofi-Team, :, Benedikt Droste +29Hybrid Mamba-Transformer Model Wireless Foundation Models
ellamind · Fraunhofer IAIS · Lamarr +8
L3Cube-MahaPOS: A Marathi Part-of-Speech Tagging Dataset and BERT Models
Jun 23, 2026Hariom Ingle, Ronit Ghode, Ishwari Gondkar +2Natural Language Datasets Tagging
Department of Information Technology, PICT, Pune, India · L3 Cube Labs, Pune, India · Indian Institute of Technology Madras, Chennai, India
Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
Jun 12, 2026NVIDIA, :, Aaron Blakeman +571Hybrid Mamba-Transformer Model Agentic Reasoning
Allan
Zamba2-VL Technical Report
May 29, 2026Hassan Shapourian, Kasra Hejazi, Olabode M. Sule +1Hybrid Mamba-Transformer Model Recent Vision-Language Models
Zyphra, San Francisco, CA
Rethinking Efficient Crack Segmentation with Task-Aligned Structural-Directional Modeling
May 29, 2026Shipeng Liu, Liang Zhao, Dengfeng Chen +1Hybrid Mamba-Transformer Model
Xi’an University of Architecture and Technology
Asymmetric Virtual Memory Paging for Hybrid Mamba-Transformer Inference
May 21, 2026An Xuan NguyenHybrid Mamba-Transformer Model Peak Memory
Codepawl Ho Chi Minh City, Vietnam
Mixture of Experts for Low-Resource LLMs
May 17, 2026Ori Bar Joseph, Smadar Arvatz, Noam Kayzer +2Mixture-Of-Experts Multilingual Language Models
3DTMDet: A Dual-Path Synergy Network of Transformer and SSM for 3D Object Detection in Point Clouds
May 15, 2026Bingwen Qiu, Yuan Liu, Junqi Bai +53D Object Detection Point Clouds
aSchool of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094, Jiangsu, China · bThe 28th Research Institute of China Electronics Technology Group Corporation, Nanjing, 210007, Jiangsu, China · cCollege of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, Jiangsu, China +2
Linear-Time and Constant-Memory Text Embeddings Based on Recurrent Language Models
Apr 20, 2026Tobias Grantner, Emanuel Sallinger, Martin FlechlHybrid Mamba-Transformer Model Transformer Architectures
Dynatrace Research · TU Wien · University of Oxford
Stateful Token Reduction for Long-Video Hybrid VLMs
Feb 27, 2026Jindong Jiang, Amala Sanjay Deshmukh, Kateryna Chumachenko +7Hybrid Mamba-Transformer Model Video-Language Models
NVIDIA
Hidden State Poisoning Attacks against Mamba-based Language Models
Jan 5, 2026Alexandre Le Mercier, Chris Develder, Thomas DemeesterHybrid Mamba-Transformer Model Attacker Large Language Model
IDLab–T2K, Ghent University–imec
Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge
Oct 22, 2025Penghao Wang, Yuhao Zhou, Mengxuan Wu +3Hybrid Mamba-Transformer Model Dataset Distillation
National University of Singapore · The University of Texas at Austin
A Multimodal Feature Distillation with Mamba-Transformer Network for Brain Tumor Segmentation with Incomplete Modalities
Apr 22, 2024Ming Kang, Fung Fung Ting, Shier Nee Saw +3Brain Tumor Segmentation Amodal Segmentation
School of Information Technology, Monash University, Malaysia Campus, Subang Jaya 47500, Malaysia · Augmented Intelligence and Multimodal analytics (AIM) for Health Lab, Faculty of Information Technology, Monash University, Clayton VIC 3800, Australia · Monash Medical AI Group, Monash University, Clayton VIC 3800, Australia +1

Sep 24, 2026, cs.LGJ/K move · Enter open · S save

Physics and Data Driven Transformer-Mamba Framework for Flow Field

Zhuo Zhang, Shun Zou, Canqun Yang, Xi Yang

College of Computer Science and Technology, National University of Defense Technology, Changsha, China · College of Artificial Intelligence, Nanjing Agricultural University, NanJing, China · National SuperComputer Center in Tianjin, Binhai New Area, Tianjin, China+1

Computational Fluid Dynamic Partial Differential Equations Hybrid Mamba-Transformer Model

Open paper AskPDF arXiv

While deep learning accelerates expensive partial differential equation solving in computational fluid dynamics (CFD), existing methods like PINNs and FNOs often struggle with generalization, noise robustness, and physical consistency. We introduce the Transformer-Mamba for Flow Field (TM4FF) framework, a physics-constrained operator learning model with three key innovations: a Residual Wavelet Mamba (RWM) layer for feature denoising, a Transformer-based attention mechanism for enhanced feature fusion, and a physics-informed loss using Fourier derivatives to enforce the Navier-Stokes equations. Experiments on four CFD datasets show TM4FF achieves high accuracy and robust generalization across varying flow conditions.

Momentum

Related topics

Latest papers 22