CRE-T1 Preview Technical Report: Beyond Contrastive Learning for Reasoning-Intensive Retrieval
Organizations: CareerInternational Research Team
Abstract
The central challenge of reasoning-intensive retrieval lies in identifying implicitreasoning relationships between queries and documents, rather than superficial se-mantic or lexical similarity. The contrastive learning paradigm is fundamentallya static representation consolidation technique: during training, it encodes hier-archical relevance concepts into fixed geometric structures in the vector space,and at inference time it cannot dynamically adjust relevance judgments accord-ing to the specific reasoning demands of each query. Consequently, performancedegrades noticeably when vocabulary mismatch exists between queries and doc-uments or when implicit reasoning is required to establish relevance. This pa-per proposes Thought 1 (T1), a generative retrieval model that shifts relevancemodeling from static alignment to dynamic reasoning. On the query side, T1 dy-namically generates intermediate reasoning trajectories for each query to bridgeimplicit reasoning relationships and uses <embtoken> as a semantic aggregationpoint for the reasoning output. On the document side, it employs an instruction+ text + <embtoken> encoding format to support high-throughput indexing. Tointernalize dynamic reasoning capabilities into vector representations, we adopt athree-stage training curriculum and introduce GRPO in the third stage, enablingthe model to learn optimal derivation strategies for different queries through trial-and-error reinforcement learning. On the BRIGHT benchmark, T1-4B exhibitsstrong performance under the original query setting, outperforming larger modelstrained with contrastive learning overall, and achieving performance comparableto multi-stage retrieval pipelines. The results demonstrate that replacing static rep-resentation alignment with dynamic reasoning generation can effectively improvereasoning-intensive retrieval performance.
Figures & tables
| Models | StackExchange | Code | Theorem-based | Avg | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bio | Earth | Econ | Psy | Rob | Stack | Sus | Pony | Leet | AoPS | TheoQ | TheoT | ||
| Evaluate Retriever with Original Query | |||||||||||||
| ReasonIR-8B | 26.2 | 31.4 | 23.3 | 30.0 | 18.0 | 23.9 | 20.5 | 10.5 | 35.0 | 14.7 | 31.9 | 27.2 | 24.4 |
| RaDeR-7B | 34.6 | 38.9 | 22.1 | 33.0 | 14.8 | 22.5 | 23.7 | 5.0 | 37.3 | 10.2 | 28.4 | 35.1 | 25.5 |
| Seed1.5-Embedding | 34.8 | 46.9 | 23.4 | 31.6 | 19.1 | 25.4 | 21.0 | 4.9 | 43.2 | 12.2 | 33.3 | 30.5 | 27.2 |
| T1-4B | 57.4 | 54.8 | 30.6 | 48.2 | 33.1 | 36.4 | 35.6 | 31.9 | 14.9 | 11.9 | 41.6 | 48.5 | 37.1 |
| Models | StackExchange | Code | Theorem-based | Avg | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bio | Earth | Econ | Psy | Rob | Stack | Sus | Pony | Leet | AoPS | TheoQ | TheoT | ||
| T1-4B (Stage 1) | 23.8 | 39.2 | 18.4 | 30.0 | 21.3 | 23.5 | 19.8 | 33.2 | 6.7 | 12.1 | 27.5 | 20.5 | 23.0 |
| T1-4B (Stage 2) | 53.8 | 53.6 | 29.5 | 44.5 | 31.8 | 34.5 | 34.8 | 36.6 | 12.7 | 11.1 | 40.7 | 45.1 | 35.7 |
| T1-4B (Stage 3) | 57.4 | 54.8 | 30.6 | 48.2 | 33.1 | 36.4 | 35.6 | 31.9 | 14.9 | 11.9 | 41.6 | 48.5 | 37.1 |
| Models | StackExchange | Code | Theorem-based | Avg | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bio | Earth | Econ | Psy | Rob | Stack | Sus | Pony | Leet | AoPS | TheoQ | TheoT | ||
| Contrastive Learning (4B) | 48.1 | 51.3 | 31.2 | 44.3 | 27.1 | 30.9 | 34.5 | 24.3 | 14.5 | 8.7 | 37.6 | 46.4 | 33.2 |
| T1-4B | 57.4 | 54.8 | 30.6 | 48.2 | 33.1 | 36.4 | 35.6 | 31.9 | 14.9 | 11.9 | 41.6 | 48.5 | 37.1 |
Generative Retrieval
Generative retrieval uses language models to produce relevant document or item identifiers directly from a query.
See all 45 papers