cs.CLNov 13, 2026

RAG-FGO: Dynamic Optimization of Query-Rewriting Agents for Generative RAG

Authors: Qigan Sun, Xudong Wang, Chaoning Zhang, Chenghao Li, Jiaquan Zhang, Jiehui Xie, Sungyoung Lee, Jie Zou, 

Organizations: School of Computing, Kyung Hee University, Yongin-si, South Korea · School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, China · School of Computer Science and Technology, Tongji University, Shanghai, China

Abstract

In retrieval-augmented generation (RAG), query rewriting serves as a core interface that aligns user intent with external knowledge bases, and its effectiveness directly determines overall system performance. However, generative retrieval faces three critical challenges in real-world deployment: noisy retrieval feedback, the difficulty of jointly optimizing discrete prompt templates and continuous decoding-control parameters, and the limited generalization of static rewriting strategies under semantically complex scenarios. To address these issues, we propose RAG-FGO, a dynamic optimization framework for generative retrieval strategies. RAG-FGO formulates query rewriting as a non-differentiable black-box optimization problem in a mixed discrete-continuous space, and represents prompt templates and decoding parameters as adaptively optimizable query-rewriting agents. The framework performs global search to enable semantic jumps and structural reorganization that escape local optima, while applying local perturbations for fine-grained alignment and precise refinement. In addition, RAG-FGO introduces an elite-preserving memory pool that accumulates high-quality strategies across iterations, thereby mitigating the impact of stochasticity and noisy feedback on optimization stability. Experimental results on a diverse suite of benchmarks demonstrate the effectiveness and robustness of the proposed method, supporting its applicability to complex semantic retrieval tasks.

Figures & tables

Explore similar work

CardsList
  1. One Size Does Not Fit All! Dynamic Retriever and Generator Selection for RAG

    Sep 15, 2026Neeraj Anand, Payel Santra, Partha Basuchowdhuri +2Retrieval-Augmented GenerationAdaptive RAG

  2. TRIO: Task Refinement with Individual Optimization for Retrieval-Augmented Generation

    Nov 2, 2026Yingtao Ren, Xiao Luo, Yiwei Fu +3Retrieval-Augmented GenerationIterative RAG

  3. CDS4RAG: Cyclic Dual-Sequential Hyperparameter Optimization for RAG

    May 8, 2026Pengzhou Chen, Tao ChenRetrieval-Augmented GenerationHyperparameter Optimization