Multimodal

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

1,956 papers

Latest in Multimodal

Open your feed →
CardsList

  1. DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering

    Sep 17, 2026Luca De Grandis, Silvia Cappelletti, William Raccagni +3Human-Annotated BenchmarkMulti-Modal Large Language Models

  2. Fingerprinting Multimodal Large Language Models

    Sep 17, 2026Chao Huang, Meng Tong, Kejiang ChenMulti-Modal Large Language ModelsFingerprint

  3. Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Models

    Sep 17, 2026Farooq Ahmad Wani, Maria Sofia Bucarelli, Mujtaba Hussain Mirza +5Cross-Modal AttentionPrompt Engineering

  4. AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models

    Sep 17, 2026Longyin Zhang, Parth Sakhare Mahendra, Chengwei Wei +4Audio-Visual ReasoningCross-Modal Learning

  5. Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning

    Sep 17, 2026Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang +2Multimodal ReasoningEfficient Latent Reasoning

  6. Region-Level Policy Optimization for Fine-grained MLLM Perception

    Sep 17, 2026Yuheng Shi, Xiaohuan Pei, Minjing Dong +1Fine-Grained PerceptionLarge Vision Language Models

  7. MiX: Micro-Inverted-Scaling for End-to-End Low-Bit Vision-Language Model Acceleration

    Sep 17, 2026Yuan Liao, Jae-sun SeoAcceleratorLarge Vision Language Models

  8. VABench: Measuring Embodied Spatial Intelligence through Visual Demonstrations, Active Perception, and Metric Control

    Sep 17, 2026Zhongbo Zhang, Jiayi Jin, Yifan Wang +4Embodied Spatial IntelligenceVisuomotor Control

  9. A Unified Evaluation Framework for Trustworthy Large Language Models, Agentic AI, and Multimodal Systems

    Sep 17, 2026Shaina Raza, Ahmed Y. Radwan, Imran Liaquat +1Trustworthy Artificial IntelligenceLarge Language Model Evaluation

  10. SCOUT: Sim-to-Real Text-Based Person Retrieval by Embedding-Space Prediction over Frozen Video Features

    Sep 16, 2026Abdarahmane Traoré, Andy Couturier, Éric HervetFrozen EncoderModality-Specific Encoders

  11. Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge

    Sep 16, 2026Dayoung Kil, Seong-heum KimUniversal MultimodalOpen-Vocabulary Object Detection

  12. From Models to Systems: A Comprehensive Survey of Efficient Multimodal Learning

    Sep 16, 2026Pan Wang, Siwei Song, Hui Ji +12Robust Multimodal LearningMultimodal Learning

  13. Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion

    Sep 16, 2026Tithi Rakshit, Hongkuan Zhou, Lavdim Halilaj +1Multi-Source Retrieval-Augmented GenerationGraph-Based Retrieval Augmented Generation

  14. MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education

    Sep 16, 2026Luyao Zhu, Xun Wei Yee, Wei Li +2Multimodal BenchmarksUniversal Multimodal

  15. Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging

    Sep 16, 2026Johannes Kaiser, Florian Braunmiller, Daniel Rückert +1Medical ImagingMultimodal Clinical Data

  16. Emotion Experience, Expression, and Perception: Emotion Analysis on Multimodal Social Media Posts

    Sep 16, 2026Christopher Bagdon, Carina Silberer, Roman KlingerEmotion RecognitionSocial Media

  17. CapMap-MS-TTA: 3rd Place Solution for the MUMU Track of the 8th LSVOS Challenge at ECCV 2026

    Sep 16, 2026Chengfeng Qiu, Kaifeng WeiVideo Object SegmentationOpen-Vocabulary Object Detection

  18. Mask 2D-3D: Adaptive Dual-Masked Autoencoder Network for Image-to-Point Cloud Registration

    Sep 16, 2026Zhixin Cheng, Jiacheng Deng, Xiaotian Yin +3Point Cloud RegistrationCross-Modal Learning

  19. Anchoring What Matters: A Dual-Level Learning Framework for Visually-Grounded Multimodal Reasoning

    Sep 16, 2026Xinxin Song, Siyuan Li, Tingxiong Xiao +1Multimodal ReasoningLarge Vision Language Models

  20. G-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement

    Sep 16, 2026Guo-Ruei Tseng, Hung-Shin Lee, Hsin-Min Wang +1Speech EnhancementAudio Latent

  21. Multimodal Conditioning of Fine-Tuned Stable Diffusion XL for Controllable and Culturally Faithful Ulos Motif Generation

    Sep 16, 2026Humasak Simanjuntak, Tamara Yunika Sianipar, Bronson T. M Siallagan +2Multimodal GenerationCultural Heritage

  22. The Unbearable Weight: Scaling Models and Methods for UAV Audio Classification

    Sep 15, 2026Andrew P. Berg, Qian Zhang, Mia Y. WangUnmanned Aerial VehiclesReal-Time Inference

  23. NeMo Data Designer: An Extensible Framework for Multimodal Synthetic Data Generation

    Sep 15, 2026Johnny Greco, Nabin Mulepati, Andre Manoel +8Synthetic DataMultimodal Generation

  24. Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos?

    Sep 15, 2026Zhaoyang Wei, Zipeng Wang, Yushe Cao +10Audio-Visual ReasoningVideo Understanding

  25. Hub-Spectral Activation of Latent Multimodal Knowledge

    Sep 15, 2026Ying Guo, Haidong Chen, Linrui Xu +7Multi-Modal Representation LearningCross-Modal Learning

  26. Artificial Intelligence-Enabled Space Robot Operations: Technologies, Challenges and Prospects

    Sep 15, 2026Zeyuan Huang, Gang Chen, Zixuan Hao +7Artificial Intelligence SystemsMultimodal Reasoning

  27. Multi-modal Knowledge Preserving Adapter for Embedding Backward Compatibility

    Sep 15, 2026Jaeseok Byun, Gukyeong Kwon, Han-Kai Hsu +4Multimodal EmbeddingsMulti-Modal Large Language Models

  28. Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation

    Sep 15, 2026Meisen Wang, Zhiqiang Tian, Wei Bao +3Cross-Modal LearningRepresentation Learning

  29. VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs

    Sep 15, 2026Haoyu Guo, Yuan Feng, Junlin Lv +3Video Multimodal Large Language Models

  30. Efficient Quantization-Aware Distillation with Cross-Modal Alignment for Edge Vision-Language Models

    Sep 15, 2026Jinwoo Jeon, GyuYeop Do, Yubin Lim +4Cross-Modal DistillationLarge Vision Language Models

  31. Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA

    Sep 15, 2026Yu Li, Zhengran Shen, Yachun Mi +2Image Quality AssessmentCross-Modal Alignment

  32. What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes

    Sep 15, 2026Zhipeng Zhao, Wenxu Wang, Peishun Liu +1Explicit Visual GroundingMultimodal Reasoning

  33. FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation

    Sep 15, 2026Guangyu Sun, Shlok Kumar Mishra, Wentao Bao +8Multi-Modal Representation LearningCross-Modal Learning

  34. AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecasting

    Sep 15, 2026Zhixiang Wu, Yining Liu, Bo Zhao +4Spatio-Temporal ForecastingCross-Modal Learning

  35. A multimodal large language model for evidence-based autism spectrum disorder screening

    Sep 15, 2026Jun Chen, Qi Zhao, Yunliang Jiang +8Autism Spectrum DisorderScreening

  36. OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

    Sep 15, 2026Chenhao Qiu, Dawei Li, Yechao Zhang +2Multimodal ReasoningOn-Policy Distillation

  37. Robust Fault Detection in Mechanical Multimodal Time Series via Self-Supervised Cross-Modal Reconstruction

    Sep 14, 2026Magnus Munk Jensen, Dorte Hammershøi, Rafał Wiśniewski +1Zero-Shot Anomaly DetectionMulti-Modal Sensing

  38. Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models

    Sep 14, 2026Alessandro Gambetti, Qiwei HanFrozen Vision-Language ModelsSemantic Similarity Metrics

  39. ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentation

    Sep 14, 2026Qiangqiang Zhou, Wenjun Tang, Yong Chen +2Open-VocabularyVision-Language Alignment

  40. MUUNRiver-Bench: Diagnosing Relation-Dependent Music Retrieval with Multimodal Instructions

    Sep 14, 2026Zhancheng Guo, Congren Dai, Shangda Wu +4Music UnderstandingAudio Representation

  41. Parameter-Efficient Adaptation of Pretrained Language Models for Time-Series Forecasting

    Sep 14, 2026Tamanna Kumavat, Georg Brunner, Kyriakos FlourisParameter-Efficient AdaptationModel Pretraining

  42. Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings

    Sep 14, 2026Mingzhou Jiang, Peixi Wu, Hang Cheng +7Multimodal EmbeddingsUniversal Multimodal

  43. PACE: Progressive Angular-to-Norm Contrastive Embedding

    Sep 14, 2026Yanping Li, Wei Zhou, Yawen Liu +7Multimodal EmbeddingsContrastive Learning

  44. AdaVSkip: Adaptive Visual Token Skipping Across Layers For Efficient MLLMs Inference

    Sep 14, 2026Yuyao Sun, Tao Deng, Shuang Li +1Visual TokensMulti-Modal Large Language Models

  45. Omni-Streaming Thinking

    Sep 14, 2026Enjun Du, Siyi Liu, Ziyu Zheng +4Omni-ModalAudio-Visual Reasoning

  46. Beyond Numerical Time Series: A Unified Benchmark for Multimodal Forecasting with Heterogeneous Context

    Sep 14, 2026Peng Chen, Zhihao Zhuang, Hongzhou Chen +6Time Series Foundation ModelsMultimodal Benchmarks

  47. Sensory Precision Inference for Multimodal Arbitration under Uncertainty

    Sep 14, 2026Tin Mišić, Takato HoriiSensory FeedbackCross-Modal Learning

  48. Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Training

    Sep 14, 2026Yuanhao Yue, Qianli Ma, Chengyu Wang +3Prompt EngineeringMultimodal Learning

  49. TwinICL: Diagnosing Multimodal In-Context Learning through Paired Counterfactuals

    Sep 14, 2026Zihan Xue, Po-Yi Lu, Serhii Honcharenko +5Robust Multimodal LearningIn-Context Learning

  50. Reading the Whole Heart: Latent-Attention Masked Autoencoders for Multimodal Cardiac Representation Learning

    Sep 14, 2026Andrea Agostini, Simon Böhi, Moritz Vandenhirtz +7Congenital Heart DiseaseCross-Modal Learning

  51. What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability

    Sep 14, 2026Lucia Cascone, Valeria Fraenza, Michele Nappi +2Audio RepresentationMulti-Modal Large Language Models

  52. Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos

    Sep 14, 2026Chenxi Yang, Yassine Ouzar, Larbi BoubchirExplainable Deepfake DetectionRemote Photoplethysmography

  53. A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data

    Sep 14, 2026Yusuf Brima, Marcellin Atemkeng, Lakshmana Rao Namamula +1AlzheimerMultimodal Clinical Data

  54. Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations

    Sep 14, 2026Xavier Anadón, Rémi Pautrat, Rui WangModality-Specific EncodersDense Prediction

  55. QuPAINT: Physics-Aware Multimodal Reasoning for Quantum Material Characterization

    Sep 14, 2026Sankalp Pandey, Xuan-Bac Nguyen, Hoang-Quan Nguyen +4Materials ScienceMicroscopy

  56. Tracing and Coordinating Cross-Layer Influence for Multimodal Model Merging

    Sep 14, 2026Pengyang Zhou, Xiaobin Tu, Zhengxi Liu +7Continual Model MergingMultimodal Learning

  57. LatentVerse: A Framework for Understanding Shared and Modality-Specific Information in Multimodal Latent Representations

    Sep 14, 2026Majd Alafrange, Samuel Friedman, John Kitonyo +2Input ModalityUnified Multimodal Models

  58. LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification

    Sep 14, 2026Hui Ye, Jing Zhang, Xiulong Yang +1Multi-Label ClassificationMulti-Modal Large Language Models

  59. RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images

    Sep 14, 2026Jiabao Wang, Wenjian Liu, Yaoming Cai +5Frequency-Spatial Fusion ModuleInfrared-Visible Image Fusion

  60. FINESSE: An Agent-Based Simulator and Benchmark Dataset for Multimodal Financial Event Sequences

    Sep 14, 2026Tyler Farnan, Benjamin Eng, Adam Abate +4Benchmark DatasetsMulti-Agent Simulations