Multimodal

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

1,965 papers

Latest in Multimodal

Browse all topics →
CardsList

  1. Illuminating Unified Multimodal Model for Free-form Interleaved Text-Image Generation

    Jun 29, 2026Chonghuinan Wang, Zhikai Chen, Chunwei Wang +9Unified Multimodal ModelsText-To-Image

  2. OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data

    Jun 29, 2026Kaixing Yang, Jiashu Zhu, Xulong Tang +8DuetVideo Dataset

  3. SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset

    Jun 29, 2026Ariel Gjaci, Antonio Sgorbissa, Vittorio MurinoCo-Speech Gesture GenerationMultimodal Generation

  4. Be Faithful When Response: Returning Fluent and Grounded Answers for Vision-Language Models Reinforcement Learning

    Jun 29, 2026Peng, Lee, Yin Zhang +9Large Vision Language ModelsMultimodal Reasoning

  5. Data-Efficient Multimodal Alignment for Histopathology-based Molecular Prediction

    Jun 29, 2026Dominik Winter, Dominik Vonficht, Loïc Le Bescond +6Computational PathologyNon-Small Cell Lung Cancer

  6. Heterogeneous Tactile Transformer

    Jun 29, 2026Jianxin Bi, Qiang Wang, Jayaram Reddy +4Tactile PerceptionCross-Sensor Generalization

  7. Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation

    Jun 29, 2026Shengqi Xu, Guojin Zhong, Yang Liu +7Tactile PerceptionContact-Rich Manipulation

  8. Traffic-CBM: A Structurally Interpretable Multimodal Framework for Encrypted Traffic Classification

    Jun 29, 2026Honglei Jin, Wenshuo Chen, Shaofeng Liang +6Network TrafficMultimodal Classification

  9. LLM-based Multimodal Personality Recognition via Facial Action Unit-Text Semantic Fusion

    Jun 29, 2026Tianyi Zhang, Wei Shan, Yuan Zong +2PersonalityVideo Multimodal Large Language Models

  10. Same Concept, Different Directions: Cross-Modal Feature Heterogeneity in Sparse Autoencoders

    Jun 29, 2026Chungpa Lee, Jihoon Kwon, Kyle Min +1Cross-Modal LearningHeterogeneity

  11. Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning

    Jun 29, 2026Xin Zou, Haolin Deng, Yibo Yan +6Multimodal ReasoningCross-View

  12. Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework

    Jun 29, 2026Yuchen He, Peizhi Ying, Liqi Cheng +4ChartMulti-Modal Large Language Models

  13. Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigation

    Jun 29, 2026Xin Zou, Haolin Deng, Yibo Yan +5Large Language Model HallucinationMulti-Modal Large Language Models

  14. Can MLLMs Critique Like Humans? Evaluating Open-Ended Aesthetic Reasoning in Multimodal Large Language Models

    Jun 29, 2026Sajjad Ghiasvand, Maryam Amirizaniani, Haniyeh Ehsani Oskouie +2AestheticsMulti-Modal Large Language Models

  15. Reliability-Prioritized Fine-Grained Generation in Multimodal Large

    Jun 28, 2026Xiaomeng Fan, Wei Wu, Yuwei Wu +9Multi-Modal Large Language ModelsMultimodal Learning

  16. Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation

    Jun 28, 2026Jongoh Jeong, Sun-Kyung Lee, Kuk-Jin YoonVision-Language AlignmentCross-Modal Learning

  17. Enhancing Part-Level Point Grounding for Any Open-Source MLLMs

    Jun 28, 2026Jin-Cheng Jhang, Fu-En Wang, Xin Yang +4Vision-Language Model GroundingContextual Grounding

  18. Low-cost concept-based localized explanations: How far can we get with training-free approaches?

    Jun 27, 2026Darian Fernández-Gutiérrez, Rafael Bello, Marilyn Bello +1Explainable Artificial IntelligenceMulti-Modal Large Language Models

  19. Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification

    Jun 27, 2026Tianshu Zhang, Yan Wang, Ji Qi +1Video Temporal GroundingLarge Vision Language Models

  20. Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers

    Jun 27, 2026Achin Jain, Jie An, Siddharth Chaudhary +1Text-To-ImageImage Generation

  21. EVLA: An Electro-Aware Multimodal Assistant for Physically-Grounded Driving Reasoning and Control

    Jun 27, 2026Yuxin Liu, Zihan Chen, Haoyu Wang +3Efficient Vision-Language-Action ModelsReal-Time Inference

  22. ExACT: Exemplar-Driven Calibrated Refinement for Training-Free Visual Grounding in Remote Sensing Images

    Jun 27, 2026Zixiao Zhang, Lingling Li, Pei He +2Remote SensingExplicit Visual Grounding

  23. Personalizing MLLMs via Reinforced Multimodal Reference Game

    Jun 27, 2026Deepayan Das, Davide Talon, Yiming Wang +2Multi-Modal Large Language ModelsMultimodal Learning

  24. Multimodal Graph RAG for Long-range Visually Rich Document Understanding

    Jun 27, 2026Yi-Cheng Wang, Chu-Song ChenVisual Document RetrievalMulti-Source Retrieval-Augmented Generation

  25. SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation

    Jun 26, 2026Sobhan Asasi, Ozge Mercanoglu Sincan, Richard BowdenSign Language RecognitionCross-Lingual Transfer

  26. IMCBench: A benchmark for multimodal LLMs in Image-grounded Medical Conversations

    Jun 26, 2026Maria Xenochristou, Ashutosh Joshi, Korosh Vatanparvar +10Multimodal Clinical DataMultimodal Benchmarks

  27. DataComp-VLM: Improved Open Datasets for Vision-Language Models

    Jun 26, 2026Matteo Farina, Vishaal Udandarao, Thao Nguyen +33Large Vision Language ModelsVision-Language

  28. AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration

    Jun 26, 2026Haotian Li, Yida Wang, Leyuan Wang +7Multi-Modal Large Language ModelsMulti-View

  29. HumanMoveVQA: Can Video MLLMs reason about human movement in videos?

    Jun 26, 2026Pulkit Gera, Faegheh Sardari, Asmar Nadeem +4Fine-Grained Video UnderstandingHuman Motion Generation

  30. Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation

    Jun 26, 2026Jian Shi, Cheng Zhen, Pingping Zhang +6Few-Shot Medical Image SegmentationMedical Image Segmentation

  31. DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data

    Jun 25, 2026Bartosz Stachowiak, Dariusz BrzezinskiPhotorealistic Video RestorationMetal Artifact Reduction

  32. Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models

    Jun 25, 2026Shravan Venkatraman, Ritesh Thawkar, Omkar Thawakar +4Large Vision Language ModelsMulti-Modal Large Language Models

  33. See & Sniff: Learning Visuo-Olfactory Representations

    Jun 25, 2026Seongyu Kim, Seungwoo Lee, Hyeonggon Ryu +2Olfactory PerceptionCross-Modal Learning

  34. CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs

    Jun 25, 2026Hashmat Shadab Malik, Anees Ur Rehman Hashmi, Numan Saeed +3Radiology Report GenerationClinical Reasoning

  35. TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference

    Jun 25, 2026Tinghao Wang, Yichen Guo, Rui Huang +11Visual Token PruningMulti-Modal Large Language Models

  36. Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation

    Jun 25, 2026Jinyu Liu, Xincheng Shuai, Henghui Ding +1Unified Multimodal ModelsUnison

  37. Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI

    Jun 25, 2026Minh Duc Do, Tillmann Rheude, Noel Kronenberg +2Magnetic Resonance ImagingCross-Modal Learning

  38. Bridging Vision and Language Concepts through Optimal Transport Semantic Flow

    Jun 25, 2026Chenyang Zhang, Anqi Dong, Guangming Zhu +4Cross-Modal LearningConcept Bottleneck Models

  39. Multi-modality Image Fusion under Adverse Weather: Mask-Guided Feature Restoration and Interaction

    Jun 25, 2026Xilai Li, Xiaosong Li, Haishu Tan +3Visible Image FusionImage Restoration

  40. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Multimodal ReasoningMultimodal Reasoning Benchmarks

  41. DiCoBench: Benchmarking Multi-Image Fine-Grained Perception via Differential and Commonality Visual Cues

    Jun 25, 2026Geng Li, Yuxin PengFine-Grained PerceptionMultimodal Benchmarks

  42. When Does Quality-Aware Multimodal Fusion Matter? A Leakage-Safe Diagnostic for Decision-Level Dependence

    Jun 25, 2026Jaden Moon, Arvind Pillai, Andrew CampbellMultimodal FusionMultimodal Learning

  43. MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation

    Jun 24, 2026Xiaochen Wang, Bao Hoang, Han Liu +2Graph-Based Retrieval Augmented GenerationMultimodal Retrieval

  44. Same Evidence, Different Answer: Auditing Order Sensitivity in Multimodal Large Language Models

    Jun 24, 2026Akshay Paruchuri, Sanmi Koyejo, Ehsan AdeliMulti-Modal Large Language ModelsFlips

  45. TriViewBench: Controlled Complexity Scaling for Multi-View Structural Reasoning in MLLMs

    Jun 24, 2026Yu-Yang Chen, Lan-Zhe GuoMulti-Modal Large Language ModelsModel Complexity

  46. From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models

    Jun 24, 2026Haoxiang Sun, Tao Wang, Li Yuan +2Multi-Modal Large Language ModelsLarge Vision Language Models

  47. ShutterMuse: Capture-Time Photography Guidance with MLLMs

    Jun 24, 2026Jiayu Li, Yixiao Fang, Tianyu Hu +5Image CroppingVideo Multimodal Large Language Models

  48. Steering Vision-Language Models with Joint Sparse Autoencoders

    Jun 24, 2026Huizhen Shu, Xuying Li, Hongxu Lin +2Improving Sparse AutoencodersCross-Modal Attention

  49. SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity

    Jun 24, 2026Tianchen Guo, Chen Liu, Ling Chen +1Multimodal BenchmarksMulti-View

  50. Cross-Attention Multimodal Learning for Predicting Response to Neoadjuvant Imatinib in Gastrointestinal Stromal Tumors: A Multicenter Retrospective Study

    Jun 24, 2026Fariba Tohidinezhad, Douwe J. Spaanderman, Natalia Oviedo Acosta +14Colorectal CancerClinical Prediction

  51. C3-Bench: A Context-Aware Change Captioning Benchmark

    Jun 24, 2026Jae-Woo Kim, Hyeongbeom Kim, Ue-Hwan KimRemote Sensing Image Change CaptioningVideo Captioning

  52. Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?

    Jun 24, 2026Tomoya Mizumoto, Yusuke FujitaSpeech EncoderSpeech Translation

  53. Text Over Image: Auditing Multimodal Robustness in Synthetic Medical Image Detection

    Jun 24, 2026Ching-Hao Chiu, Hao-Wei Chung, Gelei Xu +7Synthetic Image DetectionMultimodal Learning

  54. Omni-Perception Policy Optimization for Multimodal Emotion Reasoning

    Jun 24, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +6Multimodal ReasoningOmni-Modal

  55. iFLYTEK-Embodied-Omni Technical Report

    Jun 24, 2026Yuan Zhang, Jingfei Ni, Guanchen Lu +12Multimodal AgentsCross-Modal Attention

  56. MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning

    Jun 23, 2026Revant Teotia, Adrien Bardes, Michael Rabbat +3Joint-Embedding Predictive ArchitecturesAudio-Visual Consistency

  57. How Modular Is a Frontier Mixture-of-Experts? A Pre-registered Causal Test in Which Apparent Expert Modularity Mostly Dissolves

    Jun 23, 2026Tony Salomone, Deep Gandhi, Ali AsariaMixture-of-Experts ModelsModular Framework

  58. Agentic Collaborative Cognition for Zero-Shot 3D Understanding

    Jun 23, 2026Wenxin Wang, Bo Zhang, Feng Chen +43D Scene UnderstandingPerception-Action Loop

  59. PointVG-R: Internalizing Geometric Reasoning in MLLMs for Precise Pointing Localization via Visual Chain of Thought

    Jun 23, 2026Ling Li, Bowen Liu, Zinuo Zhan +5Sequential Visual LocalizationMulti-Modal Large Language Models

  60. ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization

    Jun 23, 2026Lei Xu, Haowei Wang, Shen Chen +3Face Forgery DetectionDigital Forensics