Multimodal RAG

RAG: Retrieval-Augmented Generation

Overview

Multimodal RAG studies how to retrieve external evidence across modalities and use it to produce grounded answers, reports, or decisions. Systems combine dense or hybrid search with techniques such as OCR and layout-aware document indexing, image-region or video-event retrieval, and graph-based evidence linking; rerankers and agents can refine what is retrieved and how it is used. This supports knowledge-based visual question answering, long-document and video understanding, and specialized applications where evidence and citations matter. Benchmarks increasingly separate retrieval quality from answer quality, while a central challenge remains ensuring that models use relevant evidence faithfully and efficiently despite noisy, biased, or poisoned context.

Latest papers

CardsList

167 papers12 papers in the last four weeks, up 9% on the four weeks before. 0.1% of all new papers.

  1. SemRAG: Semantic-Guided Sentence-Level Retrieval-Augmented Sign Language Production

    Nov 13, 2026Xiao Liu, Shiwei Gan, Yafeng Yin +5Sign Language GenerationMultimodal RAG

  2. Agri-MRAG: Parameter-Enhanced Multimodal Retrieval-Augmented Generation for Agricultural Visual Question Answering

    Nov 12, 2026Fuyong Liu, Xiantao Lei, Xining ZhangVisual Question AnsweringMultimodal RAG

  3. Faithful in Steps: Improving Generalization and Citation in RAG via Query Decomposition

    Nov 11, 2026Yue Liu, Zhongying Ru, Shimin Di +3RAG Citation FaithfulnessRetrieval-Augmented Generation

  4. Edge-Native Multimodal RAG: Hardware-Aware Quantization and Architectural Optimization for Consumer GPUs

    Nov 11, 2026Zahraa Selim, Menna Hamed, Wesam Ahmed +3Multimodal RAGRetrieval-Augmented Generation

  5. OpticalRAG: Pixel-Space Compression for Token-Efficient Retrieval-Augmented Generation

    Nov 10, 2026Senhao Liu, Yuheng Zhang, Chunyu Wei +2RAG Context CompressionMultimodal RAG

  6. MMGraph-Agent: Agentic Multimodal RAG via Cache-Inspired Multimodal Knowledge HyperGraphs

    Nov 7, 2026Haoran Luo, Ziyue Zhu, Shangyang Wu +8Multimodal RAGAgentic RAG

  7. Clips2Story: Training-Free Video Storyboarding and Editing Using Multimodal Retrieval-Embedded Generation

    Nov 4, 2026Junnuo Wang, Weihan Xu, Hao-Wen DongVideo EditingMultimodal RAG

  8. AR-RRG: Anatomy-Guided Retrieval-Driven Radiology Report Generation

    Nov 1, 2026Xiang Zhang, Shijie Song, Wanqing Zhao +8Radiology Report GenerationMultimodal RAG

  9. RouteDRAG: Learning to Route and Control Agentic Execution for Multimodal Document RAG

    Oct 27, 2026Zekai Chen, Hao Zhu, Yu Liu +5Agentic RAGMultimodal RAG

  10. Multimodal Requirements Traceability Link Recovery in Industrial Settings

    Oct 25, 2026Haoming Huang, Shinpei Hayashi, Kazuya Kohata +2Requirements EngineeringMultimodal RAG

  11. GEMS-RAG: Graph-grounded Engineering Multimodal Standards Retrieval-Augmented Generation

    Oct 23, 2026Abdul Hannan Azad, Irvin Wang, Jiwan Jiang +6Multimodal RAGRetrieval-Augmented Generation

  12. GARRET: Generative Feedback for Region Retrieval in Visual Documents

    Oct 20, 2026Weijian Jian, Siyang Chen, Yuguang Yang +4Visual Document RetrievalMultimodal RAG

  13. Enhancing RAG-based Medical VQA with Gated Multimodal Representations

    Oct 16, 2026Daniela Jimenez-Pano, Hugo Jair Escalante, Delia Irazú Hernández-FaríasGated Multimodal FusionMedical Visual Question Answering

  14. Personalization Matters: Long-Horizon Conversation Agent with User-Centric Information in Online Shopping Interactions

    Oct 8, 2026Rena Gao, Yue Dai, Hao Guan +4Agentic CommerceRecommender Systems

  15. TopoGraphRAG-Bench: Evaluating Multimodal GraphRAG on Layout-Grounded Evidence Reasoning

    Oct 7, 2026Ruochi Li, Jianzhe Lin, Haoxuan Zhang +4Graph Retrieval-Augmented GenerationMultimodal RAG

  16. EC-RAG: Event Chain Retrieval-Augmented Generation for Long Video Understanding

    Oct 6, 2026Yuhao Qin, Junbo Wang, Yuke Li +1Multimodal RAGVideo-Language Models

  17. Walking the Embedding Space: Datastore Extraction from Multimodal RAG

    Oct 1, 2026Maria Carmen Jica, Ali Satvaty, Suzan Verberne +1Multimodal RAGAdversarial Attacks on VLMs

  18. Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptation

    Sep 30, 2026Yuxin Yue, Yingchen Zhang, Ruqing Zhang +3Multimodal RAGData Visualization

  19. TAEC: Trajectory-Aware Evidence Coordination for Multi-Step Visual RAG

    Sep 29, 2026Yalun Wu, Bingzhou Wang, Boyang Wang +5Multimodal RAGVisual Question Answering

  20. UniK: Universal Knowledge Perception for Digital and Physical AI

    Sep 21, 2026Nirmit Desai, Kunal Sawarkar, Aditya Mahakali +3Multimodal RAGMultimodal IR

  21. PRISM-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Tobacco Product and Legislative Policy Reasoning

    Sep 20, 2026Manuel Serna-Aguilera, Raegan Anderes, Page Dobbs +1Multimodal RAGLegal IR

  22. Scientific Image Quality Assessment via Multi-modal Retrieval-Augmented Generation

    Sep 17, 2026Yinuo Zhang, Bingshuo Liu, Zhiying Tu +6Multimodal RAGImage Quality Assessment

  23. Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion

    Sep 16, 2026Tithi Rakshit, Hongkuan Zhou, Lavdim Halilaj +1Late FusionMultimodal RAG

  24. Navigating Sparse Evidence: Agentic Visual RAG via Explicit Context Selection and Consolidation

    Sep 14, 2026Yucheng Shen, Lingyong Yan, Jiulong Wu +4Multimodal RAGAgentic RAG