ReFormeR: Learning and Applying Explicit Query Reformulation Patterns
Organizations: University of Waterloo, Waterloo, Ontario, Canada · University of Toronto, Toronto, Ontario, Canada · University of California, Berkeley, Berkeley, California, USA
Abstract
We present ReFormeR, a pattern-guided approach for query reformulation. Instead of prompting a language model to generate reformulations of a query directly, ReFormeR first elicits short reformulation patterns from pairs of initial queries and empirically stronger reformulations, consolidates them into a compact library of transferable reformulation patterns, and then selects an appropriate reformulation pattern for a new query given its retrieval context. The selected pattern constrains query reformulation to controlled operations such as sense disambiguation, vocabulary grounding, or discriminative facet addition, to name a few. As such, our proposed approach makes the reformulation policy explicit through these reformulation patterns, guiding the LLM towards targeted and effective query reformulations. Our extensive experiments on TREC DL 2019, DL 2020, and DL Hard show consistent improvements over classical feedback methods and recent LLM-based query reformulation and expansion approaches.
Figures & tables
| Clarify Intent | Clarify Subject | Conceptual Shift | Contextual Expansion |
| Contextual Restriction | Generalization | Location Specification | Purpose Specification |
| Semantic Clarification | Temporal Adjustment |
| DL 2019 | DL 2020 | DL Hard | |||||||
| Method | mAP | nDCG | Recall | mAP | nDCG | Recall | mAP | nDCG | Recall |
| BM25 | 0.290 | 0.497 | 0.745 | 0.288 | 0.488 | 0.803 | 0.164 | 0.290 | 0.678 |
| BM25 + RM3 | 0.334 | 0.515 | 0.795 | 0.302 | 0.492 | 0.829 | 0.154 | 0.264 | 0.699 |
| BM25 + Rocchio | 0.347 | 0.528 | 0.801 | 0.312 | 0.491 | 0.816 | 0.164 | 0.277 | 0.704 |
| GenQR [ 23 ] | 0.341 | 0.517 | 0.797 | 0.336 | 0.551 | 0.840 | 0.186 | 0.313 | 0.719 |
| GenQREnsemble [ 5 ] | 0.278 | 0.442 | 0.792 | 0.287 | 0.453 | 0.795 | 0.122 | 0.197 | 0.651 |
Query Reformulation
Query reformulation transforms user questions into retrieval-ready queries to improve search, evidence coverage, and downstream answers.
See all 42 papers