Multimodal

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

1,970 papers

Latest in Multimodal

Browse all topics →
CardsList

  1. CF-Net: Conflict Fusion with Speaker Normalisation and Certainty Weighting for Ambivalence/Hesitancy Recognition

    Jul 15, 2026Tung Hung Bui, Hong Hai Nguyen, Van Thong HuynhMultimodal Deep LearningFine-Grained Video Understanding

  2. SIVA-RL: Sensitivity-Invariance Visual Alignment for Multimodal Reinforcement Learning

    Jul 15, 2026Cheng Tang, Junzhi Ning, Min Cen +9Multimodal Reasoning BenchmarksReinforcement Learning With Verifiable Reward

  3. Unleashing Multimodal Large Language Models for Training-free HOI Detection in the Wild

    Jul 15, 2026Ting Lei, Jialin Liu, Zhu Xu +2Multimodal AgentsTraining-Free Hand-Object Interaction Detection

  4. Semantic Audio-driven Understanding for Dynamic Humanoid Whole Body Control

    Jul 15, 2026J. M. A. Marcelo, M. Brienza, E. Bugli +4Long-Tail Humanoid Whole-Body ControlHuman Motion

  5. Towards Enhancing 3D Spatial Reasoning in Medical Multimodal Large Language Models

    Jul 15, 2026Zhuoyuan Fu, Zeshang Li, Yiqiong Zhang +53D Spatial ReasoningMedical Vision-Language Models

  6. SPyCE: Skill-Policy Co-evolution for Multimodal Agents

    Jul 15, 2026Ru Zhang, Weijie QiuMultimodal AgentsMultimodal Reasoning

  7. Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs

    Jul 15, 2026Zhixiao Zheng, Zheren Fu, Zhiyuan Yao +3Multi-Modal Large Language ModelsDirect Preference Optimization

  8. Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge

    Jul 15, 2026Marta Moscati, Muhammad Saad Saeed, Marina Zanoni +9Speaker IdentityMultilingual Automatic Speech Recognition

  9. Kepler-Encoder-v0.1: Towards a Multimodal Embedding Model for Robots

    Jul 15, 2026Ishneet Sukhvinder Singh, Dhanoosh Pooranakumaran, Alex Nguyen +1Robotic PerceptionProprioception

  10. Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

    Jul 14, 2026Minh-Quan Le, Armand Comas, Alexandros Lattas +7Multimodal GenerationLarge-Scale Image Generation

  11. Boogu-Image-0.1: Boosting Open-Source Unified Multimodal Understanding and Generation

    Jul 14, 2026Guoxuan Chen, Chufeng Xiao, Haoran Yang +30Text-To-ImageMultimodal Generation

  12. FormalAnalyticGeo: A Neural-Symbolic Based Framework for Multimodal Analytic Geometry Problem Generation

    Jul 14, 2026Ruoran Xu, Wending Gao, Qiufeng WangDiagramsAnnotations

  13. Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition

    Jul 14, 2026Bruce Coburn, Jingbo Yue, Jinge Ma +3Nutrient ReasoningMulti-Modal Large Language Models

  14. Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters?

    Jul 14, 2026Kaiwen Zheng, Junchen Fu, Wenhao Deng +3Multi-Modal Large Language ModelsEmotion Recognition

  15. CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models

    Jul 14, 2026Lin Peng, Cong Wan, Zeyu Guo +2Fine-Grained PerceptionMultimodal Benchmarks

  16. EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval

    Jul 14, 2026Jiashi Lin, Changhong Jiang, Xiangru Lin +12Graph-Based Retrieval Augmented GenerationKnowledge Graph Embeddings

  17. Segregate, Refine, Integrate: Decomposing Multimodal Fusion for Sentiment Analysis

    Jul 14, 2026Alexios Filippakopoulos, Elias Kallioras, Nikolaos Xiros +2Multimodal FusionCross-Modal Learning

  18. Text-Aided Multi-Modal Panoptic Symbol Spotting for CAD Floor Plan Drawings

    Jul 14, 2026Yan Gong, Bohao Li, Bowen Du +1Text-To-CadComputer-Aided Design

  19. MQAdapter: Multi-Modal Quantum Adapter for Coarse-to-Fine VLM Fine-tuning

    Jul 14, 2026Yumiao Zhao, Bo Jiang, Min Lu +2Large Vision Language ModelsFine-Grained Perception

  20. UMSS: Towards Unsupervised Multi-modal Semantic Segmentation

    Jul 14, 2026Haitian Zhang, Thai Duy Nguyen, Xiangyuan Wang +2Multimodal FusionDense Semantic Segmentation

  21. Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction

    Jul 14, 2026Md Mahfuzur Rahman, Pengzhan Zhou, A F M Abdun Noor +5Pedestrian Trajectory PredictionCross-Modal Fusion

  22. Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning

    Jul 13, 2026Jing Liu, Chenxuanyin Zou, Jiayang Ren +5Federated LearningMulti-Modal Large Language Models

  23. Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation

    Jul 13, 2026Runhui Huang, Qihui Zhang, Zhe Liu +3Text-To-ImageShared Rewards

  24. Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding

    Jul 13, 2026Kerui Chen, Jinglu Wang, Xiaoyi Zhang +1Video Multimodal Large Language ModelsSports Science

  25. Lesioned Multimodal Language Models Reproduce Aphasic Picture-Naming Patterns

    Jul 13, 2026Yong Yang, Xiang Guan, Sophie Arheix-Parras +7Dysarthric SpeechLinguistics

  26. The Ebb and Flow of Multimodal Focus: Scheduling Visual Relay Windows for Grounded VLM Reasoning

    Jul 13, 2026Wencheng Ye, Yi Bin, Yujuan Ding +7Multimodal ReasoningMultimodal Reasoning Benchmarks

  27. BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

    Jul 13, 2026Ajitesh Jamulkar, Aritra HazraJoint Audio-Video GenerationZero-Shot Text-To-Speech

  28. Towards Predictive, Aligned, and Scalable Robot Learning

    Jul 13, 2026Peijun Tang, Shangjin Xie, Baifu Huang +6Latent World ModelsScalable Robot Learning

  29. GDP.pdf: Benchmarking Grounded Multimodal Reasoning over Professional PDF Documents

    Jul 13, 2026Suhaas Garre, Emily Ritchie, Sushant Mehta +1Multimodal DocumentsMultimodal Reasoning

  30. Beyond the Eye: Efficient Multimodal Reasoning via Self-Regulated Implicit Visual Tools

    Jul 13, 2026Xiuwei Chen, Quanlin Chen, Wentao Hu +8Latent Visual ReasoningMultimodal Reasoning

  31. Affordance-Based Manipulation Planning with Text Goals and Sim-to-Real Generalisation via Real-to-Sim Image Conversion

    Jul 13, 2026Solvi Arnold, Rin Karashima, Tadashi Adachi +2AffordancesRobot Systems

  32. SVR-R1: Bootstrapping Multi-modal Reasoning with Self-verification in Reinforcement Learning

    Jul 13, 2026Mingyuan Wu, Jingcheng Yang, Shengyi Qian +11Reinforcement Learning With Verifiable RewardMultimodal Reasoning

  33. Mixture of Cognitive Experts in Large Vision-Language Models

    Jul 12, 2026Robert Wijaya, Ngai-Man CheungLarge Vision Language ModelsMultimodal Reasoning

  34. On the modality gap and the contrastive loss in multi-modal representation learning

    Jul 12, 2026Fabian Mager, Hiba Nassar, Lars Kai HansenMultimodal Contrastive LearningModality Gap

  35. SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding

    Jul 11, 2026Abhigya Verma, Khyati Mahajan, Amit Kumar Saha +4Visual Document RetrievalLongbench

  36. Generalize LMMs to Versatile Visual Modalities via Fabricated Modality Synthesis

    Jul 11, 2026Shihao Yuan, Yuanze Li, Ruyi Zhang +2Input ModalityRed-Green-Blue

  37. ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing

    Jul 11, 2026Jiakang Yu, Yixuan Chai, Tianci Wang +7Image EditingMultimodal Benchmarks

  38. What Does Your Short-Answer VQA Score Actually Measure? Evaluator-Dependent Instability in Multimodal Short-Answer Benchmarks

    Jul 11, 2026Guanhua Ye, Niu Jingbin, Yan Li +4Knowledge-Based Visual Question AnsweringLarge Language Model Judges

  39. Hearing Like Humans? Sound Symbolism and Perceptual Alignment in Speech Language Models

    Jul 11, 2026Yun-Shao Tsai, Chun-Wei Chen, Chee-En Yu +2Cross-Modal Learning

  40. TextGaze: Prompting Gaze Target Estimation with Textual Scene Cues

    Jul 11, 2026Junhui She, Fei Wang, Kun Li +4Gaze Target EstimationGaze

  41. Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation

    Jul 11, 2026Zhonghua Yi, Hao Shi, Qi Jiang +3Cross-Modal DistillationFeature Matching

  42. Local Multimodal Music Alignment from Global Supervision

    Jul 10, 2026Irmak Bukey, Zachary Novack, Jongmin Jung +2Multimodal AlignmentMultimodal Contrastive Learning

  43. Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning

    Jul 10, 2026Wenxi Gao, Guanxi Lu, Didi Zhu +5Multimodal ReasoningAd

  44. From Direction to Magnitude: How Multimodal Instruction-Tuning Reorganizes the Geometric Encoding of Identity-Specifying Prompts in Transformer Hidden States

    Jul 10, 2026Jorge A. Castillo, Marco Torres Yévenes, Juan Carlos LanasInstruction-Tuned ModelsMulti-Modal Large Language Models

  45. SAGEAgent: A Self-Evolving Agent for Cost-Aware Modality Acquisition in Multimodal Survival Prediction

    Jul 10, 2026Chongyu Qu, Can Cui, Zhengyi Lu +8Multimodal Clinical DataSurvival Predictions

  46. One-Shot Multimodal Learning from Demonstration with Force-Constrained Elastic Maps

    Jul 10, 2026Brendan Hertel, Jonathan Spanos, Navya Garg +1Ground Reaction ForcesReal-World Manipulation Tasks

  47. Multimodal Reward Hacking in Reinforcement Learning

    Jul 10, 2026Jiayu Yao, Yiwei Wang, Anmeng Zhang +5Reinforcement Learning With Verifiable RewardHacking

  48. Robustifying Vision-Language Models via Test-Time Prompt Adaptation

    Jul 10, 2026Xingyu Zhu, Huanshen Wu, Shuo Wang +4Vision-Language Model AdaptationAdversarial Transferability

  49. Validating Virtual Reality for Studying Multimodal Human-Robot Interaction in Socially Aware Robot Navigation

    Jul 10, 2026Hariharan Arunachalam, Phani Teja Singamaneni, Rachid AlamiHuman-Robot InteractionVirtual Reality

  50. MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation

    Jul 10, 2026Runhan Shi, Quan Zhou, Yuqian Xu +14Multimodal Clinical DataMultimodal Learning

  51. VTaMo: Video-Text Alignment Model for Sign Language Translation

    Jul 10, 2026Junyi Hu, Zhewen He, Haomian Huang +2Sign Language RecognitionVision-Language Alignment

  52. Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models

    Jul 10, 2026Yijie Qian, Juncheng Wang, Chao Xu +6GenerativeCross-Modal Learning

  53. Optimal Transport-based Semantic Alignment for LLM-based Audio-Visual Speech Recognition

    Jul 10, 2026Xugang Lu, Peng Shen, Yu Tsao +1Video Multimodal Large Language ModelsModality Gap

  54. TSRouter: Dynamic Modality-Model Selection for Time Series Reasoning

    Jul 9, 2026Fangxu Yu, Tao Feng, Dehai Min +3Time SeriesInference-Time

  55. Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

    Jul 9, 2026Dominick Reilly, Qiyu Wu, Hiromi Wakaki +2Multi-Modal Large Language ModelsCross-Modal Learning

  56. SHAP-Weighted Cross-Modal Expert Fusion for Emotion and Sentiment Recognition: Evidence and Limits

    Jul 9, 2026Adis Alihodzic, Selma Skopljakovic HubljarMultimodal FusionCross-Modal Fusion

  57. CT-CLIP Representations for Multimodal Lung Cancer Survival Prediction

    Jul 9, 2026Sofie Allgöwer, Mikael Johansson, Andreas Hallqvist +4Survival PredictionsNon-Small Cell Lung Cancer

  58. Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing

    Jul 9, 2026Feng Wang, Canmiao Fu, Zhipeng Huang +3Multimodal AgentsMultimodal Memory

  59. MatBind: A Shared Embedding Space for Multimodal Materials Characterization

    Jul 9, 2026Le Yang, Anoop K. Chandran, Jona Östreicher +8Materials ScienceCrystal Structure

  60. DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models

    Jul 9, 2026Pengjie Wang, Linger Deng, Zujia Zhang +6Multimodal ReasoningText-To-Image