Overview

Visual document retrieval searches documents such as forms, reports, and manuals by matching a query to evidence in page images, including text, tables, figures, and layout. Common approaches include dense single-vector embeddings, late-interaction multi-vector models that compare query and page patches, and OCR-based or sparse-text systems, often combined with reranking. Work on benchmarks such as ViDoRe and MMDocIR also explores layout-aware representations, token compression, and retrieval across multiple pages, with retrieved evidence often used in document question-answering systems. The central tension is preserving fine-grained evidence and covering all relevant pages while keeping indexes, latency, and inference costs manageable; performance can also vary with language, document type, and query complexity.

Latest papers

CardsList

69 papers6 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. KoVRE: Training an Efficient Embedding Model for Korean Visual Document Retrieval

    Aug 2, 2026Yongbin Choi, Gyuho Shim, Youngjoon JangMultimodal EmbeddingVisual Document Retrieval

  2. VaRS-Doc: Interpretation-Aware Variant Representations via Latent Self-Probing for Visual Document Retrieval

    Aug 2, 2026Haocheng Wang, Tongkun Guan, Wei Shen +1Visual Representation LearningLate Interaction Retrieval

  3. CMDR: Contextual Multimodal Document Retrieval

    Jul 7, 2026Ryota Tanaka, Taku Hasegawa, Kyosuke NishidaMultimodal IRMultimodal Embedding

  4. Hierarchical Evidence-Driven Reasoning for Long Document Understanding

    Jul 6, 2026Junyu Xiong, Yonghui Wang, Rongjian Gu +4Multi-Hop QADocument Understanding

  5. DEMUN: Fast and accurate discovery of music notation in very large collections

    Jun 30, 2026Vojtěch Dvořák, Filip Bím, Jiří Mayer +5Optical Music RecognitionVisual Document Retrieval

  6. Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity

    Jun 24, 2026Heethanjan Kanagalingam, Thenukan Pathmanathan, Mokeeshan Vathanakumar +3Multimodal RAGVisual Question Answering

  7. LightSTAR: Efficient Visual Document Retrieval via Lightweight Selection with Vision-Adaptive Refinement

    Jun 22, 2026Tongkun Guan, Haocheng Wang, Wei Shen +1Information RetrievalVisual Document Retrieval

  8. MM-Matryoshka: Towards Budget-Elastic Visual Document Retrieval via a 2D Multimodal Matryoshka Training Framework

    Jun 3, 2026Haowen Xiang, Yibo Yan, Jiahao Huo +4Representation LearningMatryoshka Representation Learning

  9. Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)

    Jun 2, 2026Jingbiao MeiMultimodal IRMultimodal Embedding

  10. PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

    Jun 1, 2026Yichuan Wang, Zhifei Li, Zirui Wang +5Multimodal RAGMultimodal QA

  11. Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search

    May 29, 2026Gyu-Hwung Cho, Youngjune Lee, Kiyoon Jeong +5Multimodal IRLearned Sparse Retrieval

  12. DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark

    May 28, 2026Ruofan Hu, Menghui Zhu, Jieming Zhu +8Multimodal IRLLM Reranking

  13. Can Retrieval Heads See Images? Multimodal Retrieval Heads in Long-Context Vision-Language Models

    May 26, 2026Aaron Branson Cigres Li, Zhaowei Wang, Yu Zhao +9Vision-Language ModelsVLM Interpretability

  14. Your Embedding Model is SMARTer Than You Think

    May 24, 2026Jianrui Zhang, Hyun Jung Lee, Sukanta Ganguly +3Multimodal IREfficient Multimodal Inference

  15. Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval

    May 23, 2026Hao Sun, Yingyan Hou, Jiayan Guo +4Multimodal EmbeddingCross-Modal Retrieval

  16. Direct content-based retrieval from music scores images

    May 21, 2026Noelia Luna-Barahona, Antonio Ríos-Vila, Félix Fuentes-Hurtado +2Music Information RetrievalVisual Document Retrieval

  17. Very Efficient Listwise Multimodal Reranking for Long Documents

    May 12, 2026Yiqun Sun, Pengfei Wei, Lawrence B. HsiehMultimodal IREfficient Multimodal Inference

  18. Beyond Bag-of-Patches: Learning Global Layout via Textual Supervision for Late-Interaction Visual Document Retrieval

    May 8, 2026Pascal Tilli, Mohsen MesgarMultimodal EmbeddingMulti-Vector Retrieval

  19. MINER: Mining Multimodal Internal Representation for Efficient Retrieval

    May 7, 2026Weien Li, Rui Song, Zeyu Li +8Multimodal EmbeddingVisual Document Retrieval

  20. Iterative Multimodal Retrieval-Augmented Generation for Medical Question Answering

    Apr 30, 2026Xupeng Chen, Binbin Shi, Chenqian Le +5Multimodal RAGRetrieval-Augmented Generation

  21. Document-as-Image Representations Fall Short for Scientific Retrieval

    Apr 20, 2026Ghazal Khalighinejad, Raghuveer Thirukovalluru, Alexander H. Oh +1Multimodal IRInformation Retrieval

  22. iDocV2: Leveraging Self-Supervision and Open-Set Detection for Improving Pattern Spotting in Historical Documents

    Apr 17, 2026Jose M. Saavedra, Crhistopher Stears, Marcelo Pizarro +2Historical Document AnalysisVisual Document Retrieval

  23. Visual Late Chunking: An Empirical Study of Contextual Chunking for Efficient Visual Document Retrieval

    Apr 11, 2026Yibo Yan, Mingdong Ou, Yi Cao +5Visual Document RetrievalMulti-Vector Retrieval

  24. Bag of Bags: Adaptive Visual Vocabularies for Genizah Join Image Retrieval

    Apr 9, 2026Sharva Gogawale, Gal Grudka, Daria Vasyutinsky-Shapira +3Visual Document RetrievalFine-Grained Image Retrieval

  25. Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Support

    Apr 9, 2026Jing Xu, Jiarui Hu, Zhihao Shuai +2Information RetrievalVisual Document Retrieval

  26. Guideline-grounded retrieval-augmented generation for ophthalmic clinical decision support

    Mar 23, 2026Shuying Chen, Sen Cui, Zhong CaoMultimodal RAGRetrieval-Augmented Generation