Multimodal Learning

Ask about this topic

Recent momentum

-18%

49 papers in the last 28 days · 0.8% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Multimodal

Neighbouring directions

Cross-Modal LearningMulti-Modal Large Language ModelsMultimodal ReasoningMultimodal BenchmarksUnified Multimodal ModelsCross-Modal AttentionInput ModalityModality Gap

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

18 new papers

A weekly snapshot of new work published in Multimodal Learning.

456 papers

Latest in Multimodal Learning

Browse all topics →
CardsList

  1. VisionAId: An Offline-First Multimodal Android Assistant for People with Visual Impairment, Featuring Personalized Object Retrieval

    Jul 2, 2026Cristian-Gabriel Florea, Stelian SpînuVision SensorsAccessibility

  2. Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors

    Jul 2, 2026Chuxi Nan, Di Wu, Hongming Guo +4MammographyNon-Small Cell Lung Cancer

  3. Hidden Forgetting in Continual Multimodal Learning: When Accuracy Survives but Grounding Fails

    Jul 2, 2026Qianyu Chen, Canran Xiao, Runxuan TangRobust Multimodal LearningCatastrophic Forgetting

  4. Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing

    Jul 2, 2026Siyuan Li, Youyuan Zhang, Ruitong Liu +2Multimodal Knowledge EditingCross-Modal Learning

  5. Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning

    Jul 1, 2026Shijie Li, Yilin Gao, Siyuan Yang +7Multi-Modal Large Language ModelsEfficient Latent Reasoning

  6. MS-Resampler: Multi-Scope Visual Resampling for Efficient Multimodal LLMs

    Jun 30, 2026Zhongyang Li, Yaqian Li, Faming Fang +6Multi-Modal Large Language ModelsMultimodal Benchmarks

  7. Evidence Triangulation for Multimodal Fact-Checking in the Wild

    Jun 30, 2026Stefanos-Iordanis Papadopoulos, Zacharias Chrysidis, Christos Koutlis +2Multilingual Fact-CheckingMisinformation Detection

  8. Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence

    Jun 30, 2026Rui Hao, Qiankun Li, Junyuan Mao +4Large Language Model HallucinationHallucination Rate

  9. AA: A Multi-view Multimodal Dataset for Screen-based Gaze Estimation

    Jun 30, 2026Chang Liu, Jiaqi Liu, Zhoutong Ye +3Gaze Target EstimationMultimodal Dataset

  10. Building a Multimodal Dataset of Academic Paper for Keyword Extraction

    Jun 30, 2026Jingyu Zhang, Xinyi Yan, Yi Xiang +2Multimodal LearningMultimodal Dataset

  11. ManimAgent: Self-Evolving Multimodal Agents for Visual Education

    Jun 29, 2026Wenjia Jiang, Zongyuan Cai, Yuanhang Shao +7Multimodal AgentsCode Generation

  12. Illuminating Unified Multimodal Model for Free-form Interleaved Text-Image Generation

    Jun 29, 2026Chonghuinan Wang, Zhikai Chen, Chunwei Wang +9Unified Multimodal ModelsText-To-Image

  13. OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data

    Jun 29, 2026Kaixing Yang, Jiashu Zhu, Xulong Tang +8DuetVideo Dataset

  14. Data-Efficient Multimodal Alignment for Histopathology-based Molecular Prediction

    Jun 29, 2026Dominik Winter, Dominik Vonficht, Loïc Le Bescond +6Computational PathologyNon-Small Cell Lung Cancer

  15. Reliability-Prioritized Fine-Grained Generation in Multimodal Large

    Jun 28, 2026Xiaomeng Fan, Wei Wu, Yuwei Wu +9Multi-Modal Large Language ModelsMultimodal Learning

  16. EVLA: An Electro-Aware Multimodal Assistant for Physically-Grounded Driving Reasoning and Control

    Jun 27, 2026Yuxin Liu, Zihan Chen, Haoyu Wang +3Efficient Vision-Language-Action ModelsReal-Time Inference

  17. Personalizing MLLMs via Reinforced Multimodal Reference Game

    Jun 27, 2026Deepayan Das, Davide Talon, Yiming Wang +2Multi-Modal Large Language ModelsMultimodal Learning

  18. Multimodal Graph RAG for Long-range Visually Rich Document Understanding

    Jun 27, 2026Yi-Cheng Wang, Chu-Song ChenVisual Document RetrievalMulti-Source Retrieval-Augmented Generation

  19. Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI

    Jun 25, 2026Minh Duc Do, Tillmann Rheude, Noel Kronenberg +2Magnetic Resonance ImagingCross-Modal Learning

  20. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Multimodal ReasoningMultimodal Reasoning Benchmarks

  21. When Does Quality-Aware Multimodal Fusion Matter? A Leakage-Safe Diagnostic for Decision-Level Dependence

    Jun 25, 2026Jaden Moon, Arvind Pillai, Andrew CampbellMultimodal FusionMultimodal Learning

  22. Text Over Image: Auditing Multimodal Robustness in Synthetic Medical Image Detection

    Jun 24, 2026Ching-Hao Chiu, Hao-Wei Chung, Gelei Xu +7Synthetic Image DetectionMultimodal Learning

  23. Omni-Perception Policy Optimization for Multimodal Emotion Reasoning

    Jun 24, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +6Multimodal ReasoningOmni-Modal

  24. Agentic Collaborative Cognition for Zero-Shot 3D Understanding

    Jun 23, 2026Wenxin Wang, Bo Zhang, Feng Chen +43D Scene UnderstandingPerception-Action Loop

  25. PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models

    Jun 23, 2026Simone Gallivanone, Hossein Khodadadi, Mauro Dore +2Adversarial ExamplesAdversarial Evaluation

  26. SlipSense: Multimodal Sensing for Online Slip Detection in Legged Robots

    Jun 23, 2026Iris Szu-Yao Liu, Chien Chern Cheah, Meng Yee Michael ChuahLegged RobotsTerrain

  27. UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation

    Jun 23, 2026Jiahao Lyu, Pei Fu, Zhenhang Li +6Image-To-Image TranslationUnified Multimodal Models

  28. Navigating User Behavior toward Personalized Multimodal Generation

    Jun 23, 2026Hengji Zhou, Yufeng Liu, Ye Liu +3Multimodal GenerationMultimodal Learning

  29. Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling

    Jun 23, 2026Kun Zhang, Chenxin Fang, Tao Chen +4Video Multimodal Large Language ModelsVideo Understanding

  30. Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction

    Jun 23, 2026Zengjie Chen, Yuxiang Cai, Jingcai Guo +3Visual Token PruningMultimodal Learning

  31. ReMMD: Realistic Multilingual Multi-Image Agentic Verification for Multimodal Misinformation Detection

    Jun 23, 2026Chenhao Dang, Dantong Zhu, Jun Yang +2Misinformation DetectionVerification-Triggered Multimodal

  32. Mind the Heads: Topological Representation Alignment for Multimodal LLMs

    Jun 22, 2026Davide Caffagni, Alberto Compagnoni, Federico Melis +5Cross-Modal AlignmentMulti-Modal Large Language Models

  33. TailorMind: Towards Preference-Aligned Multimodal Content Generation

    Jun 22, 2026Hengji Zhou, Ye Liu, Yufeng Liu +3Multimodal GenerationPreference Alignment

  34. SPAR: Semantic-Pixel Self-Alignment and Adaptive Routing for Unified Multimodal Models

    Jun 22, 2026Hongxiang Li, Hongxu Chen, Chenyang Zhu +5Unified Multimodal ModelsMultimodal Learning

  35. Efficient Multimodal Clinical Question Answering for Pulmonary Embolism Risk Assessment

    Jun 21, 2026Xiangyuan Xue, Yang Yu, Yan Gao +5Multimodal Clinical DataElectronic Health Records

  36. MMGist: A Comprehensive Multimodal Benchmark for 2027

    Jun 21, 2026Wenzhen Yuan, Jiacheng Ruan, Wutao Xiong +3Multimodal BenchmarksLarge Vision Language Models

  37. EnTrust: Modeling Inter-Modal Conflict for Trustworthy Multimodal Medical Image Analysis

    Jun 19, 2026Dwarikanath Mahapatra, Abhijit Das, Behzad Bozorgtabar +5Multimodal FusionMedical Imaging

  38. DataClaw0: Agentic Tailoring Multimodal Data from Raw Streams

    Jun 19, 2026Cong Wan, Zeyu Guo, Zijian Cai +6Multimodal Instruction TuningMultimodal Generation

  39. Building Agent Harnesses for Scientific Curation from Multimodal Sources

    Jun 19, 2026Sheng Zhang, Qin Liu, Renqian Luo +9Data-CurationScientific Workflows

  40. ELVA: Exploring Ranking-Driven Universal Multimodal Retrieval

    Jun 18, 2026Yuhan Liu, Pei Fu, Hang Li +8Multimodal RetrievalMultimodal Learning

  41. FlowMaps: Modeling Long-Term Multimodal Object Dynamics with Flow Matching

    Jun 18, 2026Francesco Argenziano, Miguel Saavedra-Ruiz, Sacha Morin +3Social Robot NavigationFlow Map

  42. Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos

    Jun 17, 2026Yuxuan Xie, Nicolas Pugeault, Chongfeng Wei +2Pedestrian Trajectory PredictionPedestrian

  43. MODE: Modality-Decomposed Expert-Level Mixed-Precision Quantization for MoE Multimodal LLMs

    Jun 15, 2026Yuanteng Chen, Peisong Wang, Zhilei Liu +9Mixture-Of-Expert Language ModelsMixed-Precision Quantization

  44. Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering

    Jun 15, 2026Jieyuan Liu, Jianyang Gu, Shijie Chen +2Knowledge-Based Visual Question AnsweringMultimodal Learning

  45. Probing, Fusion, and Trustworthiness: A Systematic Evaluation of Foundation Model Representations for Multimodal Cancer Analysis

    Jun 15, 2026Jingyu Hu, Giuseppe Tripodi, Reed Naidoo +2Pathology Foundation ModelsMultimodal Clinical Data

  46. Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs

    Jun 15, 2026Yusong Zhao, Hengyi Wang, Tanuja Ganu +2Improving Sparse AutoencodersSemantic Representations

  47. Multimodal LLM-Empowered Re-Ranking for Generalizable Person Re-Identification

    Jun 15, 2026Jiachen Li, Xiaojin GongRe-IdentificationReranking

  48. VinQA: Visual Elements Interleaved Long-form Answer Generation for Real-World Multimodal Document QA

    Jun 15, 2026Young Rok Jang, Hyesoo Kong, Kyunghwan An +3Knowledge-Based Visual Question AnsweringMultimodal Learning

  49. MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA

    Jun 14, 2026Yilong Zuo, Xunkai Li, Jing Yuan +3Multi-Source Retrieval-Augmented GenerationHievi-Rag

  50. UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analytics

    Jun 14, 2026Yanxin Xi, Xiang Su, Jie Feng +3Urban EnvironmentsMulti-Modal Large Language Models

  51. Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models

    Jun 14, 2026Kaiqing Lin, Zhiyuan Yan, Ruoxin Chen +8Digital ForensicsVideo Multimodal Large Language Models

  52. SciOrch: Learning to Orchestrate Expert LLMs for Solving Frontier Multimodal Scientific Reasoning Tasks

    Jun 14, 2026Jingru Guo, Xiangyuan Xue, Lian Zhang +6Large Language Model ReasoningScientific Discovery

  53. Mitigating Visual Hallucinations in Multimodal Systems through Retrieval-Augmented Reliability-Aware Inference

    Jun 14, 2026Pratheswaran Hariharan, Haiping Xu, Donghui YanMultimodal LearningHallucinations

  54. Unsupervised Learning for Missing Modalities in Multimodal Learning

    Jun 14, 2026Hassan Ismkhan, Hamid BouchahciaMissing ModalitiesRobust Multimodal Learning

  55. MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs

    Jun 14, 2026Hangling XieSentiment AnalysisMultimodal Learning

  56. On the Adversarial Robustness of Multimodal LLM Judges

    Jun 14, 2026Zihan Wang, Guansong Pang, Zelin Liu +3Large Language Model JudgesLlm-As-A-Judge

  57. Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction

    Jun 14, 2026Qian Feng, Hao Guo, Yan Niu +2Remote PhotoplethysmographyHeart Rate

  58. Context-aware Modality-Topology Co-Alignment for Multimodal Attributed Graphs

    Jun 12, 2026Sirui Zhang, Xu Wang, Zhengyu Wu +2Graph Foundation ModelModality Alignment

  59. LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck

    Jun 11, 2026Peixi Wu, Biao Yang, Feipeng Ma +7Multimodal EmbeddingsEfficient Latent Reasoning

  60. Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review

    Jun 10, 2026Xinyu Zhao, Rana Muhammad Shahroz Khan, Zhen Xu +2Artificial Intelligence ReviewersPeer Review