Multimodal RAG

RAG: Retrieval-Augmented Generation

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 99

All topics

EC-RAG: Event Chain Retrieval-Augmented Generation for Long Video Understanding
Oct 6, 2026Yuhao Qin, Junbo Wang, Yuke Li +1Multimodal RAG Video-Language Models
Northwestern Polytechnical University Xi’an, China
Walking the Embedding Space: Datastore Extraction from Multimodal RAG
Oct 1, 2026Maria Carmen Jica, Ali Satvaty, Suzan Verberne +1Multimodal RAG Adversarial Attacks on VLMs
University of Groningen Groningen, The Netherlands
Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptation
Sep 30, 2026Yuxin Yue, Yingchen Zhang, Ruqing Zhang +3Multimodal RAG Data Visualization
State Key Laboratory of AI Safety Institute of Computing Technology, Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing, China · University of Amsterdam Amsterdam, The Netherlands
TAEC: Trajectory-Aware Evidence Coordination for Multi-Step Visual RAG
Sep 29, 2026Yalun Wu, Bingzhou Wang, Boyang Wang +5Multimodal RAG Visual Question Answering
NExT++ Lab, National University of Singapore
UniK: Universal Knowledge Perception for Digital and Physical AI
Sep 21, 2026Nirmit Desai, Kunal Sawarkar, Aditya Mahakali +3Multimodal RAG Multimodal IR
AIntropy AI
PRISM-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Tobacco Product and Legislative Policy Reasoning
Sep 20, 2026Manuel Serna-Aguilera, Raegan Anderes, Page Dobbs +1Multimodal RAG Legal IR
Fay W. Boozman College of Public Health, University of Arkansas for Medical Sciences, Little Rock, Arkansas, 72205
Scientific Image Quality Assessment via Multi-modal Retrieval-Augmented Generation
Sep 17, 2026Yinuo Zhang, Bingshuo Liu, Zhiying Tu +6Multimodal RAG Image Quality Assessment
Harbin Institute of Technology · Tencent · Nanyang Technological University
Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion
Sep 16, 2026Tithi Rakshit, Hongkuan Zhou, Lavdim Halilaj +1Multimodal RAG Multimodal IR
University of Tübingen, Tübingen, Germany · Corporate Research, Robert Bosch GmbH, Renningen, Germany · University of Stuttgart, Stuttgart, Germany
Navigating Sparse Evidence: Agentic Visual RAG via Explicit Context Selection and Consolidation
Sep 14, 2026Yucheng Shen, Lingyong Yan, Jiulong Wu +4Multimodal RAG Agentic RAG
School of Computer Science and Technology, Soochow University · Baidu Inc.
Beyond the Query: Do Retrieval Signals Improve Adaptive Multimodal RAG Routing?
Sep 14, 2026Qiaomu Li, Qiuyuan Zhang, Nong MingMultimodal RAG Adaptive Model Routing
College of Computing and Software Engineering Kennesaw State University Marietta, GA 30060, USA
Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment
Sep 8, 2026Zhan-Lun Chang, Dong-Jun Han, Seyyedali Hosseinalipour +2Multimodal RAG Multimodal Reranking
Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA · Department of Computer Science and Engineering, Yonsei University, Seoul 03722, Republic of Korea · Department of Electrical Engineering, University at Buffalo–SUNY, Buffalo, NY 14260, USA
EM^2Mem: Event-Centric Multimodal Memory for Large Language Models
Sep 1, 2026Yijun Chen, Yaqi Zheng, Yanya Li +11Multimodal RAG Efficient Multimodal Inference
Zhejiang University · South China University of Technology · Lenovo Group Limited
Doc-REFRAG: Rethinking Multimodal Document Retrieval-Augmented Generation
Aug 31, 2026Ruofan Hu, Shengyang Xu, Minjie Hong +5Multimodal RAG Efficient Multimodal Inference
Zhejiang University
Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models?
Aug 7, 2026Jiankun Wang, Yisen Gao, Ziwei Zhang +3Multimodal RAG Visual Question Answering
School of Computer Science and Engineering, Beihang University · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology · School of Computer Science and Engineering, Guangxi Normal University +2
RAGOCR: Optical Compression of Retrieval-Augmented Text via Visual Representation
Aug 1, 2026Jiayang Yu, Jialun Zhong, Lei ZouMultimodal RAG Retrieval-Augmented Generation
Wangxuan Institute of Computer Technology, Peking University Beijing, China
DualG-MRAG: Decoupling Macro-Reasoning and Micro-Matching for Multimodal Retrieval-Augmented Generation
Jul 30, 2026Jiacheng Tao, Qingyun Sun, Haonan Yuan +2Multimodal RAG Graph Retrieval-Augmented Generation
SKLCCSE, School of Computer Science and Engineering Beihang University Beijing, China
Salient Knowledge Pathways: Sparse Cross-Modal Routing for Efficient Knowledge-Intensive Multimodal Question Answering
Jul 28, 2026Noor Islam S. Mohammad, Uluğ BayazıtMultimodal RAG Efficient Multimodal Inference
Department of Computer Science, İTÜ, İstanbul, Türkiye · Faculty of Computer Engineering, İTÜ, İstanbul, Türkiye.
DeCoRAG: Cognitive Decoupling and Semantic-Aware Cropping for Complex Document Understanding
Jul 27, 2026Shuo Wang, Kai Zhang, Wenyuan Huang +5Document Understanding Multimodal RAG
QiYuanLab, Beijing, China · Beijing University of Posts and Telecommunications, Beijing, China
HVM-GraphRAG: Holistic-View Multimodal Graph Retrieval-Augmented Generation on Complex Document
Jul 26, 2026Xin He, Yili Wang, Wenqi Fan +4Multimodal RAG Retrieval-Augmented Generation
Jilin University Changchun, China · The Hong Kong Polytechnic University Hong Kong SAR, China
CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQA
Jul 23, 2026Hanseok Oh, Parishad BehnamGhader, Benno Krojer +4VLM Evaluation Multimodal RAG
New York University, New York NY, USA · Mila - Quebec AI Institute, Montreal, Canada · McGill University, Montreal, Canada +3
VizRAG: Enhancing Retrieval-Augmented Generation with Hypergraph Visualization
Jul 22, 2026Yanbin Wei, Yang Chen, Renling Gan +7Multimodal RAG Retrieval-Augmented Generation
1Southern University of Science and Technology · 2Hong Kong University of Science and Technology · 3Huawei Research +1
TAP-RAG: Task-Aware Policy Control for Long-Document Multimodal Question Answering
Jul 21, 2026Zhong Ji, Keqi Jin, Yan Zhang +1Multimodal RAG Retrieval-Augmented Generation
School of Electrical and Information Engineering, Tianjin University · The International Joint Institute of Tianjin University, Fuzhou, Tianjin University · Department of Automation, Tsinghua University
MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation
Jul 15, 2026Yi Lin, Yihao Ding, Elana Benishay +8Radiology Report Generation Multimodal RAG
Department of Population Health Sciences, Weill Cornell Medicine, New York, USA · School of Physics, Mathematics and Computing, University of Western Australia, Crawley, Australia · Department of Radiology, Weill Cornell Medicine, New York, USA +4
EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval
Jul 14, 2026Jiashi Lin, Changhong Jiang, Xiangru Lin +12Multimodal RAG Graph Retrieval-Augmented Generation
1Northwestern Polytechnical University · 3The University of Hong Kong · 5The Chinese University of Hong Kong (Shenzhen) +2
Trust Before Fusion: QIMG-7 and Source-Aware Resolution for Polluted Multimodal RAG
Jul 12, 2026Saadeldine Eletter, Owais Aijaz, Preslav NakovMultimodal RAG Retrieval-Augmented Generation
Mohamed bin Zayed University of Artificial Intelligence
MMAgent-R $^2$ : Learning to Rerank and Reject for Agentic mRAG
Jul 8, 2026Tao Zhang, Ziqi Zhang, Zongyang Ma +7Multimodal RAG Adaptive Retrieval
State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA · School of Artificial Intelligence, University of Chinese Academy of Sciences · Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information +3
VaseMuseum: Digital Intelligent Museum for Ancient Greek Pottery
Jul 7, 2026Jiazi Wang, Nonghai Zhang, Qiushi Xie +5Multimodal RAG Cultural Heritage
School of Computer Science and Technology, Beijing Jiaotong University, Beijing 100044, China · School of Computer Science, Peking University, Beijing 100871, China · Department of Computer Science and Information Technology, La Trobe University, Melbourne VIC 3000, Australia +1
Hierarchical Evidence-Driven Reasoning for Long Document Understanding
Jul 6, 2026Junyu Xiong, Yonghui Wang, Rongjian Gu +4Multi-Hop QA Document Understanding
University of Science and Technology of China · iFLYTEK Research
Modality Relevance is not Modality Utility: Post-hoc Selective Modality Escalation for Cost-Aware Multimodal RAG
Jul 3, 2026Xue Li, Yiming GaiMultimodal RAG Efficient Multimodal Inference
Hangzhou International Innovation Institute, Beihang University Hangzhou, China
VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
Jul 3, 2026Zhenkun Gao, Yicheng Bao, Jinlong Peng +13Multimodal RAG Video QA
East China Normal University · Tencent Youtu Lab · HFIPS, Chinese Academy of Sciences +3
MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Support
Jul 2, 2026Lihui Luo, Joongwon Chae, Ziyan Chen +13Multimodal RAG Medical Diagnosis
Institute of Biopharmaceutics and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, 518000, China · Chinese Medicine Guangdong Laboratory, Zhuhai, 519000, China · XiaoMing TCM Hospital, Shenzhen, 518000 China +3
Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach
Jul 1, 2026Md Abu Hanif Shaikh, Abdullah Al ShafiMultimodal RAG Multimodal QA
Institute of Information and Communication Technology, Khulna University of Engineering & Technology, Khulna, Bangladesh
Hybrid Retriever Evolution for Multimodal Document Reasoning Agents
Jun 28, 2026Bohan Yao, Shruthan Radhakrishna, Vikas YadavMultimodal RAG Multimodal QA
1ServiceNow · University of Washington
Multimodal Graph RAG for Long-range Visually Rich Document Understanding
Jun 27, 2026Yi-Cheng Wang, Chu-Song ChenMultimodal RAG Visual Question Answering
Department of Computer Science and Information Engineering, National Taiwan University · FinTech Center, National Taiwan University
ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering
Jun 26, 2026ZhengXian Wu, Hangrui Xu, Kai Shi +8Multimodal RAG Multimodal Search Agents
OPPO AI Center, OPPO Inc. China · The Shenzhen International Graduate School, Tsinghua University · Nanyang Technological University, Singapore
PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation
Jun 25, 2026Kexu Cheng, Zicheng Liu, Mingju Gao +2Multimodal RAG Physical Consistency in Video Generation
School of Computer Science, Peking University, Beijing, China · Institute of AI for Industries, Chinese Academy of Sciences, Nanjing, China
MIRROR: Novelty-Constrained Memory-Guided MCTS Red-Teaming for Agentic RAG
Jun 25, 2026Inderjeet Singh, Andrés Murillo, Motoyoshi Sekiya +2Multimodal RAG Tool-Augmented Language Model Agents
Fujitsu Research of Europe, United Kingdom · Fujitsu Limited, Japan
MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation
Jun 24, 2026Xiaochen Wang, Bao Hoang, Han Liu +2Multimodal RAG Retrieval-Augmented Generation
The Pennsylvania State University University Park, Pennsylvania, USA · Michigan State University East Lansing, Michigan, USA · Dalian University of Technology Dalian, Liaoning, China +1
Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity
Jun 24, 2026Heethanjan Kanagalingam, Thenukan Pathmanathan, Mokeeshan Vathanakumar +3Multimodal RAG Visual Question Answering
The University of Melbourne, Melbourne, Australia · Lakehead University, Thunder Bay, Canada
Ground Then Rank: Revisiting Knowledge-Based VQA with Training-Free Entity Identification
Jun 22, 2026Qian Ma, Qiong Wu, Zhengyi Zhou +1Multimodal RAG Visual Question Answering
Rensselaer Polytechnic Institute · AT&T Chief Data Office
Look Before You Zoom: Adaptive Routing for the Resolution-Context Trade-off in Visual RAG
Jun 20, 2026Oanh N. Tran, Thanh Quoc Hung Le, Oscar Chew +2Multimodal RAG Efficient VLM Inference
VinUni-Illinois Smart Health Center, VinUniversity · Texas A&M University
Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning
Jun 17, 2026Minh-Loi Nguyen, Xuan-Vu Le, Long-Bao Nguyen +2Multimodal RAG Multimodal IR
University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation
Jun 16, 2026Zehang Wei, Jiaxin Dai, Jiamin Yan +1Multimodal RAG Multi-Agent LLM Systems
School of AI and Automation, Huazhong University of Science and Technology, China · School of Computer Science & Tech, Huazhong University of Science and Technology
CIAN: Multi-Stage Framework for Event-Enriched Image Captioning via Retrieval-Augmented Generation
Jun 16, 2026Trinh Thi Thu Hien, Trung-Nghia LeMultimodal RAG Image Captioning
Faculty of Information Technology, University of Science, Ho Chi Minh City · 2Vietnam National University, Ho Chi Minh City, Vietnam
Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering
Jun 15, 2026Jieyuan Liu, Jianyang Gu, Shijie Chen +2VLM Evaluation Multimodal RAG
University of California, San Diego · The Ohio State University
MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA
Jun 14, 2026Yilong Zuo, Xunkai Li, Jing Yuan +3Multimodal RAG Graph Retrieval-Augmented Generation
Beijing Institute of Technology
Rethinking RAG in Long Videos: What to Retrieve and How to Use It?
Jun 11, 2026Yuho Lee, Jisu Shin, Nicole Hee-Yeon Kim +5Multimodal RAG Egocentric Video Understanding
KAIST, YH, Seoul, Republic of Korea · Qualcomm AI Research, Qualcomm Korea, YH, Seoul, Republic of Korea
Findings of the MAGMaR 2026 Shared Task
Jun 10, 2026Alexander Martin, Dengjia Zhang, Joel Brogan +7Multimodal RAG Multimodal Grounding
Johns Hopkins University · OpenAI · University of Maryland, Baltimore County +4
One Token per Multimodal Evidence: Latent Memory for Resource-Constrained QA
Jun 9, 2026Zhi Zheng, Ziqiao Meng, Hao Luan +2Multimodal RAG Multimodal Memory
School of Computing, National University of Singapore
Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation
Jun 6, 2026Jiaxin Dai, Zehang Wei, Jiamin Yan +1Multimodal RAG Agentic RAG
School of AI and Automation, Huazhong University of Science and Technology, China · School of Computer Science & Tech, Huazhong University of Science and Technology
FLOWREADER: Min-Cost Flow Optimization for Multi-Modal Long Document Q&A
Jun 5, 2026Ambuj Mehrish, Sebastiano VasconMultimodal RAG Multimodal QA
Ca’ Foscari University of Venice
MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA
Jun 4, 2026Kaifeng Chen, Hongtao Liu, Qiyao Peng +4Multimodal RAG Multimodal QA
Tianjin University, Tianjin, China · Qifu Technology, Beijing, China · Beihang University, Beijing, China +1
MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
Jun 2, 2026Hanoz Bhathena, Parin Rajesh Jhaveri, Rohan Mittal +7Multimodal RAG Multimodal QA
JPMorgan Chase & Co. · Georgia Institute of Technology
PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation
Jun 1, 2026Yichuan Wang, Zhifei Li, Zirui Wang +5Multimodal RAG Multimodal QA
1UC Berkeley · 2Princeton University · 5Renmin University of China +2
TrafficRAG: A Multimodal RAG Framework for Traffic Accident Liability Determination
Jun 1, 2026Xu Li, Zedong Fu, Xinyi Li +1Multimodal RAG Intelligent Transportation Systems
Southwest Petroleum University, China · Sichuan Police College, China
TechRAG: Evidence-Gated Multimodal Agentic RAG for Technical Literature Reasoning
Jun 1, 2026Kanwar Bharat SinghMultimodal RAG Scientific QA
Global Tire Intelligence and Solutions (GTIS) The Goodyear Tire & Rubber Company
CASTLE2026 Team WDL Technical Report
May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Multimodal RAG Egocentric Video QA
Key Laboratory of Intelligent Perception and Image Understanding
HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering
May 28, 2026Joongmin Shin, Gyuho Shim, Jeongbae Park +2Multimodal RAG Multimodal IR
Human-inspired AI Research, Korea University · Department of Computer Science and Engineering, Korea University · Computer Science and Engineering, Konkuk University
CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning
May 28, 2026Xiang Fang, Wanlong Fang, Changshuo WangMultimodal RAG Retrieval-Augmented Generation
School of Software Engineering, Huazhong University of Science and Technology · Nanyang Technological University, Singapore · University College London
MARQUIS: A Three-Stage Pipeline for Video Retrieval-Augmented Generation
May 17, 2026Debashish Chakraborty, Dengjia Zhang, Jialiang Jin +7Multimodal RAG Retrieval-Augmented Generation
Johns Hopkins University · Human Language Technology Center of Excellence

Oct 6, 2026, cs.CVJ/K move · Enter open · S save

EC-RAG: Event Chain Retrieval-Augmented Generation for Long Video Understanding

Yuhao Qin, Junbo Wang, Yuke Li, Yining Zhu

Northwestern Polytechnical University Xi’an, China

Multimodal RAG Video-Language Models Long-Video Understanding Temporal Video Understanding

Open paper AskPDF arXiv

Current large video-language models (LVLMs) still face challenges when dealing with long videos, mainly because frames are often processed independently, making it difficult to capture temporal dependencies across events. Although retrieval-augmented approaches have been introduced to provide additional context, most of them operate at the frame or snippet level, which limits their ability to model how events evolve over time and relate to each other. In this paper, we propose Event Chain Retrieval-Augmented Generation (EC-RAG), a training-free framework that organizes video content into an explicit event chain before question answering. Instead of retrieving isolated frames or text segments, EC-RAG first partitions the video into semantically coherent segments, represents each segment using multi-modal signals, and then links them into a structured chain that preserves temporal order and captures inter-event relationships. Given a query, the system identifies relevant events within this chain and gathers supporting evidence from the associated modalities. Our approach offers several practical advantages: (i) event-level abstraction that better reflects how video content is naturally structured, enabling more reliable localization compared to frame-level retrieval; (ii) structured multi-modal fusion that aggregates speech, text, and visual cues at the event level, allowing complementary information to be more effectively utilized during reasoning; and (iii) plug-and-play compatibility with existing LVLM backbones, requiring no additional training or reliance on proprietary models. Experiments on Video-MME, MLVU, and LongVideoBench show that this event-centric design consistently outperforms frame-level retrieval baselines, highlighting the importance of modeling temporal structure for long-video understanding.

Momentum

Related topics

Latest papers 99