Probe-then-Plan: Environment-Aware Planning for Industrial E-commerce Search
Organizations: JD.com, Beijing, China
Abstract
Modern e-commerce search is evolving to resolve complex user intents. While Large Language Models (LLMs) offer strong reasoning, existing LLM-based paradigms face a fundamental blindness-latency dilemma: query rewriting is agnostic to retrieval capabilities and real-time inventory, yielding invalid plans; conversely, deep search agents rely on iterative tool calls and reflection, incurring seconds of latency incompatible with industrial sub-second budgets. To resolve this conflict, we propose Environment-Aware Search Planning (EASP), reformulating search planning as a dynamic reasoning process grounded in environmental reality. EASP introduces a Probe-then-Plan mechanism: a lightweight Retrieval Probe exposes the retrieval snapshot, enabling the Planner to diagnose execution gaps and generate grounded search plans. The methodology comprises three stages: (1) Offline Data Synthesis: A Teacher Agent synthesizes diverse, execution-validated plans by diagnosing the probed environment. (2) Planner Training and Alignment: The Planner is initialized via Supervised Fine-Tuning (SFT) to internalize diagnostic capabilities, then aligned with business outcomes (conversion rate) via Reinforcement Learning (RL). (3) Adaptive Online Serving: A complexity-aware routing mechanism selectively activates planning for complex queries, ensuring optimal resource allocation. Extensive offline evaluations and online A/B testing on JD.com demonstrate that EASP significantly improves relevant recall and achieves substantial lifts in UCVR and GMV. EASP has been successfully deployed in JD.com's AI-Search system.
Figures & tables
| State | Diagnosis | Strategy | Transformation Flow ( q\xrightarrow{\text{{Perception in (q,O_{init})}}}\mathcal{P} ) |
| Effective | State: High relevance | Preservation | : “iPhone 17 Pro” : {“iPhone 17 Pro”} |
| Recall Failure | Gap: Query Noise | Sanitization | : “laptttop wth 32G” : {“laptop 32GB RAM”} |
| State: Inventory Void | No Refinement | : “brand X water” : HALT | |
| Precision Failure | Bias: Entity drift | Concretization | : “bottoms match green shirt” : {“khakis ”, “jeans”} |
| Bias: Granularity mismatch | : “camping” : {“tent”, “sleeping bag”} | ||
| Gap: Attribute misalignment | : “high shrimp snack” : {“60% ratio shrimp snack”} |
| Method | REL@30 | HR@30 (%) | Latency |
| Blind Rewriter | 20.7 | 28.6 | low (ms level) |
| w/o RL | 23.0 | 29.5 | low (ms level) |
| ReAct Agent | 24.1 | 30.2 | high (s level) |
| EASP(ours) | 23.3 | 31.0 | low (ms level) |