RL for IR

RL: Reinforcement Learning · IR: Information Retrieval

Overview

Reinforcement learning for information retrieval studies how systems can learn what to retrieve, how to rank it, and when to stop using feedback from downstream tasks or user interactions. Approaches include policy-gradient methods such as PPO, GRPO, and REINFORCE, offline methods such as CQL and IQL, and joint training of search agents, retrievers, and rankers. Work spans multi-hop question answering and agentic search, retrieval benchmarks such as BEIR and BRIGHT, and industrial settings including e-commerce search and recommendation. A central challenge is assigning useful credit when rewards are delayed or sparse: intermediate evidence and process rewards can guide learning, but may be noisy, invite reward hacking, or trade off against retrieval cost and generalization.

Latest papers

CardsList

56 papers6 papers in the last four weeks, down 73% on the four weeks before. 0.0% of all new papers.

  1. MARS: Training Multilingual Search Agents for Retriever-Free Evidence Acquisition

    Nov 6, 2026Rui Qi, Yunlong Liang, Yufeng Chen +3Multilingual IRMultilingual RAG

  2. Retrieving from Your Own Mistakes: On-Policy Training of Embedding Models for Multi-Hop Retrieval-Augmented Generation

    Oct 29, 2026Chenjie Qiu, Zixuan Zeng, Shaobin Shi +3Multi-Hop RAGRetrieval-Augmented Generation

  3. Cheap Retrieval and Observation Credit Assignment from One Quantity: The Value of Information

    Oct 29, 2026Daniel Strauss, Nikolaos Sotirakis, Zhenshan Bing +1Reinforcement LearningMemory-Augmented RL

  4. Heterogeneous Co-Evolution Learning for Tool-Efficient Search Agents with Zero Labels

    Oct 29, 2026Qin-Wen Luo, Sheng Ren, Xiang Chen +6LLM Agent TrainingLLM Agent Efficiency

  5. RANGER: Retrieval Agent for Navigating Graphs with Semantic Evaluation Rewards

    Oct 20, 2026Artem Mikhaylov, Pavel Konoplev, Nikolay Efanov +2Knowledge Graph Question AnsweringLLM-Guided RL

  6. EG-GRPO: Evidence-Guided Step-level Credit Assignment for Deep Search Agents

    Oct 18, 2026Sijia Luo, Mengjie Gao, Yuxiao He +4RL for LLM AgentsStep-Level Credit Assignment in RL

  7. Learning to Program Retrievals: Composing Search Primitives via Reinforcement Learning

    Oct 17, 2026Kyuyoung Kim, Zilin Xiao, Zhiyuan Wang +4Retrieval-Augmented ReasoningRL for RAG

  8. Expert-Guided Rubrics as Dense Reward Signals for Reinforcement Learning in Non-Verifiable Domains

    Oct 17, 2026Ashish Bansal, Hossam Amer, Keerat Kaur Guliani +3RL for LLM AgentsReward Design for RL

  9. RL-Guided Temporal Localization for Dual-Channel Retrieval in Long-Horizon Agent Memory

    Oct 16, 2026Dabin Sheng, Zhe Wu, Jinming Zhao +2Temporal IRAgentic Retrieval

  10. Grounded Credit Assignment in Reinforcement Learning for Multi-Turn Search Agents

    Oct 16, 2026Qirui Liu, Hao Chen, Yi Wen +7Credit Assignment in RLReinforcement Learning with Verifiable Rewards

  11. Reasoning Reranking with Semantic IDs as the Sole Item Representation

    Oct 16, 2026Zhenwei Tang, Jintao Liu, Di Bai +2LLM RerankingSemantic ID Recommendation

  12. KnowGPO: Knowledge-Grouped Policy Optimization for Search Agents

    Oct 15, 2026Siqi Chen, Zhengxi Lu, Yuchen Yan +10RL for LLM AgentsReinforcement Learning

  13. Co-adaptive Rule Routing and Constraining for Structured Knowledge Retrieval

    Oct 10, 2026Zhisheng Qi, Haoyu Han, Jiaxi Li +9Information RetrievalAdaptive Retrieval

  14. Autoregressive Retriever: Improving Query Understanding from Item Feedback for Universal Multimodal Retrieval

    Oct 8, 2026Jianfei Zhao, Yifan Wang, Feng Zhang +7Information RetrievalCross-Modal Retrieval

  15. Beyond Outcome Rewards: Constructing and Assigning Retrieval Credit for Search Agents

    Oct 7, 2026Wenyu Huang, Xinyu Hou, Pavlos Vougiouklis +2Reward Design for RLRL for IR

  16. Learning to Retrieve via Reinforcement Learning in Embedding Space

    Oct 6, 2026Qi Liu, Fengming Liang, Yiqun Chen +2RL for IRText Embedding Models

  17. T-Search: An Open Agentic Retriever and Playground for Hard Multi-Step Search

    Oct 5, 2026Olga Tsymboi, Ramil Latypov, Aleksandr Medvedev +5Multi-Hop QAAgentic Search

  18. Learning to Route in Visual Space via Multi-Step Embedding Retrieval

    Sep 30, 2026Tianyu Chen, Mingyuan Zhou, Jiaxing WuMultimodal Search AgentsAgentic Retrieval

  19. Learning to Retrieve Missing Evidence for Long-Term Memory QA

    Sep 29, 2026Yi-Xuan Deng, Yi Zhang, Wei Liu +2RL for IREvidence Retrieval

  20. Efficient Offline Learning of Ranking Policies via Top-kk Policy Decomposition

    Sep 29, 2026Ren Kishimoto, Koichi Tanaka, Haruka Kiyohara +4Learning to RankOff-Policy RL

  21. IGSD: Environment-Verified Hindsight Self-Distillation for Search Agents

    Sep 26, 2026Angqing Jiang, Gaoming Zhang, Chaoqun Zhang +5Self-DistillationAgentic Search

  22. Search-Aware Reinforcement Learning for Multi-Component Query Understanding in Roblox Game Search

    Sep 24, 2026Nayoung Choi, Shengjian Chen, Xiaokai Wei +6Reinforcement LearningRL for IR

  23. What Should We Ask Next? Retrieval-Aware Question Learning for Interactive ReID

    Sep 18, 2026Lyucheng Qian, John Yuehan Zhang, Pingyu WangPerson Re-IdentificationRL for IR

  24. It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning

    Sep 1, 2026Runpeng Dai, Kaili Huang, Changsung Kang +1Reinforcement LearningGenerative Retrieval