Multimodal RAG

RAG: Retrieval-Augmented Generation

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 100

All topics

VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
Jul 3, 2026Zhenkun Gao, Yicheng Bao, Jinlong Peng +13Multimodal RAG Video QA
East China Normal University · Tencent Youtu Lab · HFIPS, Chinese Academy of Sciences +3
MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Support
Jul 2, 2026Lihui Luo, Joongwon Chae, Ziyan Chen +13Multimodal RAG Medical Diagnosis
Institute of Biopharmaceutics and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, 518000, China · Chinese Medicine Guangdong Laboratory, Zhuhai, 519000, China · XiaoMing TCM Hospital, Shenzhen, 518000 China +3
Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach
Jul 1, 2026Md Abu Hanif Shaikh, Abdullah Al ShafiMultimodal RAG Multimodal QA
Institute of Information and Communication Technology, Khulna University of Engineering & Technology, Khulna, Bangladesh
Hybrid Retriever Evolution for Multimodal Document Reasoning Agents
Jun 28, 2026Bohan Yao, Shruthan Radhakrishna, Vikas YadavMultimodal RAG Multimodal QA
1ServiceNow · University of Washington
Multimodal Graph RAG for Long-range Visually Rich Document Understanding
Jun 27, 2026Yi-Cheng Wang, Chu-Song ChenMultimodal RAG Visual Question Answering
Department of Computer Science and Information Engineering, National Taiwan University · FinTech Center, National Taiwan University
ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering
Jun 26, 2026ZhengXian Wu, Hangrui Xu, Kai Shi +8Multimodal RAG Multimodal Search Agents
OPPO AI Center, OPPO Inc. China · The Shenzhen International Graduate School, Tsinghua University · Nanyang Technological University, Singapore
PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation
Jun 25, 2026Kexu Cheng, Zicheng Liu, Mingju Gao +2Multimodal RAG Physical Consistency in Video Generation
School of Computer Science, Peking University, Beijing, China · Institute of AI for Industries, Chinese Academy of Sciences, Nanjing, China
MIRROR: Novelty-Constrained Memory-Guided MCTS Red-Teaming for Agentic RAG
Jun 25, 2026Inderjeet Singh, Andrés Murillo, Motoyoshi Sekiya +2Multimodal RAG Tool-Augmented Language Model Agents
Fujitsu Research of Europe, United Kingdom · Fujitsu Limited, Japan
MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation
Jun 24, 2026Xiaochen Wang, Bao Hoang, Han Liu +2Multimodal RAG Retrieval-Augmented Generation
The Pennsylvania State University University Park, Pennsylvania, USA · Michigan State University East Lansing, Michigan, USA · Dalian University of Technology Dalian, Liaoning, China +1
Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity
Jun 24, 2026Heethanjan Kanagalingam, Thenukan Pathmanathan, Mokeeshan Vathanakumar +3Multimodal RAG Visual Question Answering
The University of Melbourne, Melbourne, Australia · Lakehead University, Thunder Bay, Canada
Ground Then Rank: Revisiting Knowledge-Based VQA with Training-Free Entity Identification
Jun 22, 2026Qian Ma, Qiong Wu, Zhengyi Zhou +1Multimodal RAG Visual Question Answering
Rensselaer Polytechnic Institute · AT&T Chief Data Office
Look Before You Zoom: Adaptive Routing for the Resolution-Context Trade-off in Visual RAG
Jun 20, 2026Oanh N. Tran, Thanh Quoc Hung Le, Oscar Chew +2Multimodal RAG Efficient VLM Inference
VinUni-Illinois Smart Health Center, VinUniversity · Texas A&M University
Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning
Jun 17, 2026Minh-Loi Nguyen, Xuan-Vu Le, Long-Bao Nguyen +2Multimodal RAG Multimodal IR
University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation
Jun 16, 2026Zehang Wei, Jiaxin Dai, Jiamin Yan +1Multimodal RAG Multi-Agent LLM Systems
School of AI and Automation, Huazhong University of Science and Technology, China · School of Computer Science & Tech, Huazhong University of Science and Technology
CIAN: Multi-Stage Framework for Event-Enriched Image Captioning via Retrieval-Augmented Generation
Jun 16, 2026Trinh Thi Thu Hien, Trung-Nghia LeMultimodal RAG Image Captioning
Faculty of Information Technology, University of Science, Ho Chi Minh City · 2Vietnam National University, Ho Chi Minh City, Vietnam
Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering
Jun 15, 2026Jieyuan Liu, Jianyang Gu, Shijie Chen +2VLM Evaluation Multimodal RAG
University of California, San Diego · The Ohio State University
MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA
Jun 14, 2026Yilong Zuo, Xunkai Li, Jing Yuan +3Multimodal RAG Graph Retrieval-Augmented Generation
Beijing Institute of Technology
Rethinking RAG in Long Videos: What to Retrieve and How to Use It?
Jun 11, 2026Yuho Lee, Jisu Shin, Nicole Hee-Yeon Kim +5Multimodal RAG Egocentric Video Understanding
KAIST, YH, Seoul, Republic of Korea · Qualcomm AI Research, Qualcomm Korea, YH, Seoul, Republic of Korea
Findings of the MAGMaR 2026 Shared Task
Jun 10, 2026Alexander Martin, Dengjia Zhang, Joel Brogan +7Multimodal RAG Multimodal Grounding
Johns Hopkins University · OpenAI · University of Maryland, Baltimore County +4
One Token per Multimodal Evidence: Latent Memory for Resource-Constrained QA
Jun 9, 2026Zhi Zheng, Ziqiao Meng, Hao Luan +2Multimodal RAG Multimodal Memory
School of Computing, National University of Singapore
Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation
Jun 6, 2026Jiaxin Dai, Zehang Wei, Jiamin Yan +1Multimodal RAG Agentic RAG
School of AI and Automation, Huazhong University of Science and Technology, China · School of Computer Science & Tech, Huazhong University of Science and Technology
FLOWREADER: Min-Cost Flow Optimization for Multi-Modal Long Document Q&A
Jun 5, 2026Ambuj Mehrish, Sebastiano VasconMultimodal RAG Multimodal QA
Ca’ Foscari University of Venice
MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA
Jun 4, 2026Kaifeng Chen, Hongtao Liu, Qiyao Peng +4Multimodal RAG Multimodal QA
Tianjin University, Tianjin, China · Qifu Technology, Beijing, China · Beihang University, Beijing, China +1
MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
Jun 2, 2026Hanoz Bhathena, Parin Rajesh Jhaveri, Rohan Mittal +7Multimodal RAG Multimodal QA
JPMorgan Chase & Co. · Georgia Institute of Technology
PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation
Jun 1, 2026Yichuan Wang, Zhifei Li, Zirui Wang +5Multimodal RAG Multimodal QA
1UC Berkeley · 2Princeton University · 5Renmin University of China +2
TrafficRAG: A Multimodal RAG Framework for Traffic Accident Liability Determination
Jun 1, 2026Xu Li, Zedong Fu, Xinyi Li +1Multimodal RAG Intelligent Transportation Systems
Southwest Petroleum University, China · Sichuan Police College, China
TechRAG: Evidence-Gated Multimodal Agentic RAG for Technical Literature Reasoning
Jun 1, 2026Kanwar Bharat SinghMultimodal RAG Scientific QA
Global Tire Intelligence and Solutions (GTIS) The Goodyear Tire & Rubber Company
CASTLE2026 Team WDL Technical Report
May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Multimodal RAG Egocentric Video QA
Key Laboratory of Intelligent Perception and Image Understanding
HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering
May 28, 2026Joongmin Shin, Gyuho Shim, Jeongbae Park +2Multimodal RAG Multimodal IR
Human-inspired AI Research, Korea University · Department of Computer Science and Engineering, Korea University · Computer Science and Engineering, Konkuk University
CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning
May 28, 2026Xiang Fang, Wanlong Fang, Changshuo WangMultimodal RAG Retrieval-Augmented Generation
School of Software Engineering, Huazhong University of Science and Technology · Nanyang Technological University, Singapore · University College London

Jul 3, 2026, cs.CVJ/K move · Enter open · S save

VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning

Zhenkun Gao, Yicheng Bao, Jinlong Peng, Xueheng Li+12

East China Normal University · Tencent Youtu Lab · HFIPS, Chinese Academy of Sciences+3

Multimodal RAG Video QA Tool-Using Vision-Language Agents RL for VLMs

Open paper AskPDF arXiv

Video understanding is moving beyond closed-context perception toward open-world evidence exploration, a paradigm formalized as Video Deep Research (VDR). However, existing multimodal search agents primarily target static images, and the current VDR benchmark relies on text-centric retrieval that discards crucial visual information. To address these limitations, we propose VideoSearcher, a closed-loop agentic framework that empowers Vision-Language Models with multi-tool reasoning for VDR. VideoSearcher unifies temporal localization, spatial focusing, and multimodal search within a single reasoning trajectory, enabling agents to progressively ground visual clues, retrieve relevant evidence, and synthesize answers. To optimize knowledge-intensive reasoning trajectories, we propose Bi-branch Sequence Policy Optimization (BiSPO), a reinforcement learning algorithm that decouples tool-invocation optimization from answer-accuracy optimization. This design provides stable learning signals for both evidence-grounded reasoning and purposeful tool use. Furthermore, we construct VideoSearch-QA, the first benchmark designed to evaluate open-world video information grounding and multimodal search-based reasoning. Extensive experiments demonstrate that VideoSearcher significantly outperforms prior open-source agentic baselines across various search-oriented and multimodal understanding benchmarks.

Momentum

Related topics

Latest papers 100