Efficient Multimodal Inference

Ask about this topic

Momentum

28 papers in the last four weeks, up 211% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 157

All topics
CardsList

  1. Omni-Prune: Query-Aware Unified Token Pruning for Efficient Omnimodal Large Language Models

    Jul 26, 2026Yiming Zhong, Chang Nie, Caifeng ShanEfficient Multimodal InferenceMultimodal Large Language Models

    1Nanjing University

  2. OmniScope: Modality-Decoupled Token Compression for Omnimodal Large Language Models

    Jul 25, 2026Jinsen Su, Yongdong Luo, Yuexiao Ma +3Efficient Multimodal InferenceAudio Token Compression

    Media Analytics and Computing Lab, Xiamen University, Xiamen, China · Institute of Artificial Intelligence, Xiamen University, Xiamen, China · School of Informatics, Xiamen University, Xiamen, China +1

  3. Out of Sight, Still in Mind: Token Compression for Omni-LLMs

    Jul 23, 2026Suho Yoo, Youngjoon Jang, Hyebin Cho +1Efficient Multimodal InferenceMultimodal Large Language Models

    KAIST · VGG, University of Oxford

  4. Beyond Independent Optimization: Compression, MoE Routing, and Quantization Interactions in Multimodal Edge Intelligence

    Jul 23, 2026Jay Gor, Karm Dave, Akshita Abrol +3Efficient Multimodal InferenceVLM Quantization

    Nirma University · Singapore Institute of Technology, Singapore · Department of CE-AI and Big Data, Marwadi University

  5. Look Less, Think Faster: Joint Token-Compute Adaptation for Multimodal LLMs

    Jul 22, 2026Pengcheng Wang, Zhiquan Wang, Jayoung Lee +5Efficient Multimodal InferenceEfficient VLM Inference

    Purdue University, West Lafayette, IN, USA · University of Wisconsin–Madison, Madison, WI, USA · NVIDIA, Santa Clara, CA, USA

  6. OmniReasoner: Thinking with Long Audio-Video via Native Tool Use

    Jul 21, 2026Yu Chen, Caorui Li, Ziyu Xiong +8Temporal Video GroundingAudio-Visual Understanding

    University of Chinese Academy of Sciences · Institute of Automation, CAS · Southeast University +3

  7. FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications

    Jul 20, 2026Krish Agarwal, Zhuoming Chen, Yanyuan Qin +3Efficient Multimodal InferenceLLM Inference Acceleration

    Carnegie Mellon University · AMD · University at Buffalo

  8. Stop Thinking, Start Looking: Efficient Post-Training for Multimodal Document Question Answering via Reasoning-Free Alignment

    Jul 16, 2026Harikrishnan P M, Goutham Vignesh, Ganesh Parab +4Multimodal GroundingEfficient Multimodal Inference

    Phi Labs, Quantiphi, India · Phi Labs, Quantiphi, Canada.

  9. Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters?

    Jul 14, 2026Kaiwen Zheng, Junchen Fu, Wenhao Deng +3Efficient Multimodal InferenceMultimodal Large Language Models

    University of Glasgow United Kingdom · Institute of Computing Technology, Chinese Academy of Sciences China · School of Artificial Intelligence, Shandong University China +1

  10. Full-Pipeline Inference Optimization for MiMo-V2.5 Series: Pushing Hybrid SWA Efficiency to the Limit

    Jul 14, 2026Xiaomi MiMo Team, Anqi Liu, Aoxin Ma +28Efficient Multimodal InferenceKV Caching

    MiMo Team, Xiaomi

  11. Beyond the Eye: Efficient Multimodal Reasoning via Self-Regulated Implicit Visual Tools

    Jul 13, 2026Xiuwei Chen, Quanlin Chen, Wentao Hu +8Efficient Multimodal InferenceTool Use in VLMs

    Sun Yat-sen University, China

  12. Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning

    Jul 10, 2026Wenxi Gao, Guanxi Lu, Didi Zhu +5Efficient Multimodal InferenceUnified Multimodal Models

    Imperial College London · Tsinghua University

  13. Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learning

    Jul 9, 2026Yiyang Fang, Pei Fu, Jinjie Li +7Efficient Multimodal InferenceRL for Language Model Reasoning

    Wuhan University · The Hong Kong University of Science and Technology · Xiaomi Inc +2

  14. DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models

    Jul 9, 2026Pengjie Wang, Linger Deng, Zujia Zhang +6Efficient Multimodal InferenceUnified Multimodal Models

    Huazhong University of Science and Technology · MiLM Plus, Xiaomi Inc.

  15. Hierarchical Multi-to-Single-Modal Knowledge Distillation for Disruption Prediction in EAST

    Jul 5, 2026Qiang Chen, Xiao Wang, Hao Si +9Cross-Modal Knowledge DistillationEfficient Multimodal Inference

    School of Computer Science and Technology, Anhui University, Hefei 230031, China · Institute of Plasma Physics, Chinese Academy of Sciences, Hefei 230031, China · State Key Laboratory of Opto-Electronic Information Acquisition and Protection Technology, Anhui University, Hefei 230039, China

  16. InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection

    Jul 4, 2026Zichao Feng, Haodong Zhu, Jingying Yang +8Efficient Multimodal InferenceMultimodal Robustness

    Beihang University, Beijing, China · Zhongguancun Academy, Beijing, China · Communication University of China, Beijing, China +1

  17. Modality Relevance is not Modality Utility: Post-hoc Selective Modality Escalation for Cost-Aware Multimodal RAG

    Jul 3, 2026Xue Li, Yiming GaiMultimodal RAGEfficient Multimodal Inference

    Hangzhou International Innovation Institute, Beihang University Hangzhou, China

  18. OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance

    Jul 3, 2026Mengzhang Li, Yuan YaoEfficient Multimodal InferenceOn-Device Inference

    Shanghai Qizhi Institute · College of AI, Tsinghua University

  19. OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models

    Jul 3, 2026Shijie Cao, Qingyu Zhang, Boxi Yu +6Efficient Multimodal InferenceMultimodal Large Language Models

    School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Limerick +1

  20. Gemma 4 Technical Report

    Jul 2, 2026Gemma Team, Sherif El Abd, Vaibhav Aggarwal +298Efficient Multimodal InferenceUnified Multimodal Models

  21. CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts

    Jun 30, 2026Lianyu Hu, Shengqian Qin, Zeqin Liao +4Efficient Multimodal InferenceEfficient Language Model Reasoning

    Nanyang Technological University, Singapore · Shanghai Jiao Tong University, China · NKIARI, Shenzhen Futian, China +2

  22. Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning

    Jun 30, 2026Kaitao Chen, Weiqian Zhao, Jiamin Wu +6Efficient Multimodal InferenceMedical VQA

    1Fudan University · 2Shanghai Artificial Intelligence Laboratory · 3Shanghai Jiao Tong University +1

  23. HVPNet: A Bio-Inspired Network for General Salient and Camouflaged Object Detection

    Jun 30, 2026Jiawei Xu, Qiangqiang Zhou, Zhouping Li +3Efficient Multimodal InferenceSalient Object Detection

    aSchool of Artificial Intelligence, Jiangxi Normal University, Street, Nanchang, 330000, State, China · bFaculty of Business Information, Shanghai Business School, Zhongshan West Road, Shanghai, 200235, China · cSchool of Computer Science and Information Engineering, Shanghai Institute of Technology, Street, Shanghai, 201418, China

  24. Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning

    Jun 29, 2026Yinan Zhou, Haokun Lin, Yichen Wu +7Efficient Multimodal InferenceAdaptive Model Routing

    Xi’an Jiaotong University · ARC Lab, Tencent IEG · City University of Hong Kong +3

  25. DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning

    Jun 29, 2026Xinxin Chen, Yuchen Li, Zihan Wang +3Efficient Multimodal InferenceMulti-Agent Collaboration

    University of Chinese Academy of Sciences

  26. One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding

    Jun 29, 2026Chen Liu, Ling Chen, Hanzhang Zhou +5Efficient Multimodal InferenceGUI Grounding

    University of Technology Sydney · Tongyi Lab, Alibaba Group · Adelaide University

  27. Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification

    Jun 27, 2026Tianshu Zhang, Yan Wang, Ji Qi +1Temporal Video GroundingEfficient Multimodal Inference

    Tsinghua University

  28. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Efficient Multimodal InferenceKV Caching

    Sun Yat-sen University · Shenzhen Loop Area Institute · Harbin Institute of Technology (HIT) +3

  29. Methane-Plume Segmentation From Hyperspectral Satellite Imagery Via Multimodal Deep Learning

    Jun 24, 2026Brayan Quintero, Jeferson Acevedo, Samuel Traslaviña +1Efficient Multimodal InferenceRemote Sensing Image Segmentation

    Department of Computer Science, Universidad Industrial de Santander Bucaramanga, 680002, Colombia

  30. Latent Visual States for Efficient Multimodal Reasoning

    Jun 23, 2026Xiuwei Chen, Wentao Hu, Yongxin Wang +8Efficient Multimodal InferenceLarge Vision-Language Models

    Sun Yat-sen University · The Hong Kong Polytechnic University · MBZUAI +2

  31. Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling

    Jun 23, 2026Kun Zhang, Chenxin Fang, Tao Chen +4Efficient Multimodal InferenceMultimodal Large Language Models

    Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China

  32. Spectral Evolution-Guided Token Pruning in Multimodal Large Language Models

    Jun 23, 2026Bin Chen, Yuxiang Cai, Yadan Luo +3Efficient Multimodal InferenceMultimodal Large Language Models

    School of Software Technology, Zhejiang University, Ningbo, China · Zhejiang Key Laboratory of Digital-Intelligence Service Technology, China · The University of Queensland, St Lucia, QLD, Australia +2

  33. Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse

    Jun 22, 2026Bole Ma, Jan Eitzinger, Harald Koestler +1Efficient Multimodal InferenceKV Caching

  34. Efficient Multimodal Clinical Question Answering for Pulmonary Embolism Risk Assessment

    Jun 21, 2026Xiangyuan Xue, Yang Yu, Yan Gao +5Efficient Multimodal InferenceMultimodal QA

    University of Auckland, Auckland, New Zealand · University of Cambridge, Cambridge, United Kingdom · University of Adelaide, Adelaide, Australia +1

  35. PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models

    Jun 17, 2026Yueyi Sun, Yuhao Wang, Jason Li +8Efficient Multimodal InferenceImage Captioning

    Peking University MSALab, ByteDance

  36. Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning

    Jun 17, 2026Pengyu Li, Zhitao Gao, Lingling Zhang +5Cross-Modal Knowledge DistillationEfficient Multimodal Inference

    Xi’an Jiaotong University · Shaanxi Province Key Laboratory of Big Data Knowledge Engineering · MOE KLINNS Lab, Xi’an Jiaotong University +1

  37. Stepwise Token Selection for Efficient Multimodal Large Language Models

    Jun 14, 2026Landi He, Shawn Young, Lijian XuEfficient Multimodal InferenceMultimodal Large Language Models

    Shenzhen University of Advanced Technology

  38. DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning

    Jun 13, 2026David Huang, Lianlei ShanEfficient Multimodal InferenceMultimodal Reasoning

    University of Toronto · Tsinghua University

  39. ProMUSE: Progressive Multi-modal Uncertainty-guided Staged Evidential Alzheimer Disease Classification

    Jun 11, 2026Long Doan, Branden Chen, Ethan Litton +6Efficient Multimodal InferenceEvidential Deep Learning

    Department of Computer Science, Kennesaw State University · Department of Data Science and Analytics, Kennesaw State University · Department of Information Technology, Kennesaw State University +2

  40. LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck

    Jun 11, 2026Peixi Wu, Biao Yang, Feipeng Ma +7Efficient Multimodal InferenceMultimodal Embedding

    University of Science and Technology of China · 2Kuaishou Technology · 3Zhejiang University +1

  41. M*: A Modular, Extensible, Serving System for Multimodal Models

    Jun 10, 2026Atindra Jha, Naomi Sagan, Keisuke Kamahori +9Efficient Multimodal InferenceDistributed Inference

    Stanford University · University of Washington · Carnegie Mellon University

  42. InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning

    Jun 10, 2026Ziang Yan, Sheng Xia, Jiashuo Yu +10Efficient Multimodal InferenceMultimodal Reasoning

    Shanghai AI Laboratory · Shanghai Innovation Institute · Nanjing University

  43. ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation

    Jun 8, 2026Yihua Zhang, Mingfu Liang, Jiyan Yang +11Efficient Multimodal InferenceMultimodal CoT Reasoning

    Meta AI · Michigan State University · The University of North Carolina at Chapel Hill +1

  44. From Senses to Decisions: The Information Flow of Auditory and Visual Perception in Multimodal LLMs

    Jun 8, 2026Wish Suharitdamrong, Muhammad Awais, Xiatian Zhu +1Efficient Multimodal InferenceMultimodal Large Language Models

    Surrey Institute for People-Centred AI (PAI), University of Surrey, UK · Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, UK

  45. Late-Layer Fusion is Enough: Dual-Path Vision Token Routing for Multimodal Large Language Models under Visual Saturation

    Jun 8, 2026Siyuan Liu, Jinyang WuEfficient Multimodal InferenceMultimodal Large Language Models

    aSchool of Mechanics and Engineering Science, Peking University, China · bDepartment of Automation, Tsinghua University, China

  46. Look Less, Reason More: Block-wise Attention Skipping for Efficient Multimodal LLMs

    Jun 7, 2026Jie Ma, Zhike Qiu, Jiayi Ji +2Efficient Multimodal InferenceMultimodal Large Language Models

    Xiamen University

  47. M3^3Exam: Benchmarking Multimodal Memory for Realistic User-Agent Interactions

    Jun 5, 2026Zhengjun Huang, Wenxuan Liu, Zhoujin Tian +6Multimodal GroundingEfficient Multimodal Inference

    The Hong Kong University of Science and Technology · Peng Cheng Laboratory · Beijing University of Chemical Technology +4

  48. Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoning

    Jun 5, 2026Yinzhou Tang, Jingbo Xu, Yu Shang +4Efficient Multimodal InferenceWorld Models for Robotics

    Tsinghua University · Manifold AI

  49. DisasterBench: A Multimodal Benchmark for UAV-Based Disaster Response in Complex Environments

    Jun 4, 2026Tan Zhang, Quanyou Li, Lu Zhang +3Efficient Multimodal InferenceMultimodal Reasoning

    School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China · School of Information and Communication Engineering, Dalian University of Technology, Dalian, 116024, China · School of Computing and Communications, Lancaster University, Lancaster, LA1 4YW, England +1

  50. Beyond Generative Decoding: Discriminative Hidden-State Readout from a Native Omni-Modal LLM for Multimodal Sentiment Analysis

    Jun 4, 2026Bin Wen, Tien-Ping TanEfficient Multimodal InferenceSentiment Analysis

    School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia.

  51. Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning

    Jun 3, 2026Niloufar Alipour Talemi, Hossein Kashiani, Fatemeh AfghahEfficient Multimodal InferenceMultimodal ICL

    Holcombe Department of Electrical and Computer Engineering, Clemson University, Clemson, United States.

  52. Differentiable Efficient Operator Search

    Jun 3, 2026Xiaohuan Pei, Jiyuan Zhang, Yuanfan Guo +4Efficient Multimodal InferenceMultimodal Token Compression

    1The University of Sydney · 2ByteDance · 3Shanghai Jiao Tong University +1

  53. Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile Agents

    Jun 2, 2026Zhijie Ding, Weinan Hong, Zicheng Zhu +6Efficient Multimodal InferenceProactive Assistance

    HyperAI Team, Xiaomi Corporation · Zhongnan University of Economics and Law · 1HyperAI Team, Xiaomi Corporation +5

  54. Spectral-Progressive Thought Flow for Lightweight Multimodal Reasoning

    Jun 1, 2026Yixian Shen, Zhiheng Yang, Qi Bi +6Efficient Multimodal InferenceVisual Spatial Reasoning

    Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands · University of Thessaly, Volos, Greece · Department of Computer Science, University College London +3

  55. Improving Visual Token Reduction via Rectifying Distortions for Efficient Multimodal LLM Inference

    Jun 1, 2026Hyeonwoo Cho, Donghyeon Baek, Yewon Kim +1Efficient Multimodal InferenceMultimodal Large Language Models

    Yonsei University · Korea Institute of Science and Technology (KIST)

  56. VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning

    May 29, 2026Hengbo Xu, Shengjie Jin, Yanbiao Ma +1Efficient Multimodal InferenceVisual Attention

    Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China.

  57. MARS Policy: Multimodality Only When It Matters

    May 28, 2026Jindou Jia, Tuo An, Yuxuan Hu +7Efficient Multimodal InferenceRobot Policy Learning

    1MARS Lab, Nanyang Technological University

  58. DREAM-R: Multimodal Speculative Reasoning with RL-Based Refined Drafting, Precise Verification, and Fully Parallel Execution

    May 27, 2026Yunhai Hu, Zining Liu, Xiangyang Yin +5Efficient Multimodal InferenceRL for Language Model Reasoning

    New York University · University of Pennsylvania · Cerebras Systems

  59. ProgVLA: Progress-Aware Robot Manipulation Skill Learning

    May 27, 2026Seungsu Kim, Jinyoung Choi, Seungmin Baek +1Cross-Modal LearningEfficient Multimodal Inference

    NAVER LABS Europe · NAVER LABS

  60. ROVER: Routing Object-Centric Visual Evidence for Grounded Multi-Image Reasoning

    May 27, 2026Guannan Lv, Ren Nie, Hongjian Dou +1Multimodal GroundingEfficient Multimodal Inference

    Kuaishou Technology