IR Evaluation

IR: Information Retrieval

Ask about this topic

Momentum

15 papers in the last four weeks, up 36% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 122

All topics
CardsList

  1. Guardian Crawler: Retrieval-First Knowledge Discovery with Bounded LLM Augmentation for Noisy Web Intelligence

    Aug 10, 2026Joshua Castillo, Santosh Nukavarapu, Ravi MukkamalaHybrid IRInformation Retrieval

    Department of Computer Science Old Dominion University

  2. FinRank: An Evidence-Grounded Benchmark for Financial Question Answering and Retrieval over SEC Filings

    Aug 7, 2026Sasan Mansouri, Daniel Saad, Mark Wahrenburg +2Data ProvenanceFinancial QA

    University of Groningen, Groningen, Netherlands · Goethe University Frankfurt, Frankfurt am Main, Germany · DataNXT GmbH, Frankfurt am Main, Germany +2

  3. Comparative Approaches to Agent Retrieval over Large Skill Libraries

    Aug 6, 2026Indivara Kolluru, Nathan SportsmanGraph-Based RetrievalLLM Agent Skill Retrieval

    Praetorian

  4. Mapping Similarity Spaces across Embedding Models with Synthetic Query Probing

    Aug 6, 2026Marcin Rozmus, Peter van der PuttenText Embedding EvaluationText Embedding Models

    GenAI Engineering, Pegasystems, Kraków, Poland · AI Lab, Pegasystems, Amsterdam, The Netherlands · LIACS, Leiden University, Leiden, the Netherlands

  5. Search, Inspect, Fetch: Exploiting Structure-Aware Boolean Retrieval for Deep-Research Agents

    Aug 3, 2026Shuai Wang, Haodong Chen, Yu Yin +3Deep Research AgentsWeb Search Agents

    The University of Queensland, Brisbane, Australia · CSIRO, Brisbane, Australia

  6. Advancing Relevance Measurement with Vision-Language Models for Web-Scale Search

    Aug 3, 2026Han Wang, Alex Whitworth, Pak Ming Cheung +5VLM EvaluationAutomated Evaluation

    Pinterest · San Francisco, CA, USA

  7. Diagnosing Search Behavior and Failure Modes in Long-Horizon Search Agents

    Aug 3, 2026Qi Liu, Jiaxin Mao, Fengbin Zhu +1Deep Research AgentsLong-Horizon Agent Evaluation

    Renmin University of China Beijing, China · National University of Singapore Singapore

  8. HIERA: Hierarchical Multi-Agent Relevance Assessment for Content Discovery Systems

    Aug 1, 2026Pritom Saha Akash, Phanideep Gampa, Chao Shen +2Multi-Agent CoordinationIR Evaluation

    Amazon

  9. Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiability

    Jul 31, 2026Jeonghwan Choi, Taewon Yun, Minjeong Ban +3Reference-Free EvaluationRAG Evaluation

    1Korea Advanced Institute of Science and Technology (KAIST) · 2Cluvion

  10. Human Preference aligned Tabular Similarity

    Jul 27, 2026Frederik Hoppe, Astrid Franz, Marianne Michaelis +2Human Preference EvaluationTabular Representation Learning

    CONTACT Software GmbH, Bremen, Germany

  11. Do Current Retrievers Cover All the Evidence? A Controlled Study of Conjunctive Cross-Page Retrieval

    Jul 27, 2026Sungguk Cha, DongWook Kim, Mintae Kim +3Information RetrievalVisual Document Retrieval

    LG Uplus, Seoul, South Korea

  12. Choosing a Text Embedding Model: A Practical Benchmarking and Decision Framework

    Jul 26, 2026Madhav S BaidyaModel SelectionText Embedding Evaluation

    Indian Institute of Technology (BHU) Varanasi

  13. Evaluation design conditions the expert-vs-auto MeSH gap: a controlled comparison of bag-of-words and BiomedBERT on the Cohen benchmark

    Jul 23, 2026Samuel M. Okoe-MensahBenchmark DesignEvidence Selection

    Accra, Ghana

  14. A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset

    Jul 23, 2026Katerina Papantoniou, Panagiotis Papadakos, Theodore Patkos +3Text Embedding EvaluationMultilingual IR

    ICS-FORTH Heraklion, Greece · Crete University Press Heraklion, Greece · University of Crete, Computer Science Department, Heraklion, Greece

  15. Achieving Text-based Person Retrieval with Any Granularity

    Jul 23, 2026Jialong Zuo, Hanyu Zhou, Dongyue Wu +5Cross-Modal RetrievalInformation Retrieval

    National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China · School of Software Engineering, Huazhong University of Science and Technology, Wuhan 430074, China

  16. Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking

    Jul 22, 2026Kailin Jiang, Lei Liu, Jian Xi +7Learning to RankRubric-Based Evaluation

    University of Science and Technology of China · Yuanbao Team, Tencent · University of Chinese Academy of Sciences +1

  17. Presentation, Not Mechanism: A Render Confound in Deprecation-Aware Memory Evaluation

    Jul 17, 2026Zhaoyang Jiang, Zhizhong Fu, Zicheng Li +5LLM MemoryQuestion Answering

    School of Health & Wellbeing, University of Glasgow, Glasgow, UK · School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China · Institute of Health Informatics, University College London, London, UK +1

  18. Finding the Right Tables and Columns: A Benchmark and Corpus-Adaptive Embeddings for SQL Schema Retrieval

    Jul 14, 2026Qingcheng Zeng, Puxuan Yu, Aman Mehta +2Schema LinkingText-to-SQL

    Northwestern University · Snowflake Inc.

  19. Similar Accuracy, Unequal Evidence: Search APIs as Decision Surfaces for Tool-Using Agents

    Jul 11, 2026Sriram Selvam, Anneswa GhoshAgentic SearchIR Evaluation

  20. FindMyText: Robust, Scalable Detection of Text Containment in Large Web-Crawled Corpora

    Jul 10, 2026Lars Henry Berge Olsen, Pierre Lison, Martin Jullum +1IR Evaluation

    Norwegian Computing Center, Oslo, Norway.

  21. Evaluating RAG Metrics in Applied Contexts: An Experiment, Its Findings and Its Limitations

    Jul 8, 2026Quentin BrabantRAG EvaluationAutomated Evaluation

    Orange Research, Lannion, France

  22. Faithful or Findable? Evaluating LLM-Generated Metadata for RDF Dataset Search

    Jul 7, 2026Riccardo Terrenzi, Serkan AyvazIR EvaluationSynthetic Data Evaluation

    University of Southern Denmark Sønderborg, Denmark

  23. Submitted and Diagnostic Analysis of Full-Text Temporal Retrieval for LongEval-Sci

    Jul 5, 2026Yingdong Yang, Haijian WuTemporal IRInformation Retrieval

    Jena, Germany

  24. Scientific Code Search at Scale: A Multi-Domain Dataset and Benchmark

    Jul 3, 2026Nishan Pantha, Pranath Reddy Kumbam, Sajil Awale +8Benchmark DesignInformation Retrieval

    The University of Alabama in Huntsville (UAH), Huntsville, AL, USA · Universities Space Research Association (USRA), USA · NASA Marshall Space Flight Center, Huntsville, AL, USA

  25. Bringing Agentic Search to Earth Observation Data Discovery

    Jul 2, 2026Minghan Yu, Youran Sun, Chugang Yi +2Agentic SearchRemote Sensing

    University of Maryland, College Park · University of Florida

  26. Field Order Should Not Matter: Permutation-Invariant Embedding Model Fine-Tuning for Structured Metadata Retrieval

    Jun 29, 2026Aivin V. Solatorio, Olivier Dupriez, Rafael MacalabaMultilingual IRInformation Retrieval

    Development Data Group, Office of the Chief Statistician, World Bank Group

  27. SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics

    Jun 29, 2026Nikolay Georgiev, Maria Drencheva, Kseniia Ibragimova +3Text Embedding EvaluationLLM Reranking

    INSAIT, Sofia University “St. Kliment Ohridski” · ETH Zurich

  28. When Retrieval Metrics Mislead: Measuring Policy Signal in Long-Horizon Tool-Use Agents

    Jun 22, 2026Tianyu Ding, Juan Pablo De la Cruz WeinsteinTool-Use EvaluationRetrieval-Augmented Classification

    Amazon Web Services

  29. HAKARI-Bench: A Lightweight Benchmark for Comparing Retrieval Architectures and Efficiency Settings under Unified Conditions

    Jun 22, 2026Yuichi TatenoBenchmark DesignText Embedding Evaluation

  30. ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments

    Jun 18, 2026Tingyue Pan, Mingyue Cheng, Daoyu Wang +4Agentic SearchInformation Retrieval

    State Key Lab of Cognitive Intelligence, University of Science and Technology of China