Dual-Stream LLM-Guided Reward Design for Reject-Inference-Aware Reinforcement Learning in E-Commerce Payment Fraud Detection
Organizations: eBay
Abstract
Production fraud-detection models learn from a censored slice of their own traffic: transactions a legacy system blocked never receive fraud labels, so models train on a biased, approved-only distribution. We extend LLM-guided reward design, the framework of Qu et al. (2025) in which an LLM evolves the reward of a two-step REINFORCE fraud-blocking policy, to attack this reject-inference problem inside the reward. A single LLM designs a dual-stream reward: stream 1 applies the standard dollar-weighted precision objective to labeled transactions; stream 2 scores legacy-blocked, unlabeled transactions by contrasting the newest gradient-boosted risk signal against the legacy scores that drove the original block. Rather than prescribe which signals matter, we expose a superset of evidence and let the LLM decide for itself which to use, guided by evaluation feedback alone; because it writes the reward as code, that choice is directly auditable. On a held-out four-month out-of-time test, the dual-stream agent beats the prior labeled-only agent at every target recall, by +4.7, +2.4 and +3.0 points of dollar-weighted precision at 80%, 85% and 90% recall, and the production baseline by +6.8 points on average. The resulting policy is architecturally identical to that of Qu et al. (2025) and adds no inference cost.
Figures & tables
| $Precision | $TP stopped at PRA | ||||
| $Recall | Base | SS | DS | SS | DS |
| 80% | 47.09% | 50.41% | 55.15% | 64.8% | 67.1% |
| 85% | 39.95% | 44.00% | 46.36% | 81.6% | 94.8% |
| 90% | 29.91% | 32.95% | 35.92% | 12.5% | 64.8% |
| avg | 38.98% | 42.45% | 45.81% | ||
| targets satisfying Eq. 1 | 2 / 3 | 3 / 3 | |||
| R | Apr | May | Jun | Jul |
| DS SS | ||||
| 80% | 2.80 | 1.00 | 1.91 | 4.77 |
| 85% | 2.83 | 5.28 | 1.15 | 4.97 |
| 90% | 2.08 | 1.36 | 7.23 | 3.81 |
| DS Base | ||||
| 80% | 0.99 | 3.51 | 1.43 | 0.62 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| SS | DS | ||
| $Recall | $Prec | $Recall | $Prec |
| 0.5773 | 0.6788 | 0.5012 | 0.6690 |
| 0.5773 | 0.6788 | 0.5646 | 0.6629 |
| 0.6256 | 0.6565 | 0.6117 | 0.6479 |
| 0.6513 | 0.6120 | 0.6594 | 0.6394 |
| 0.7016 | 0.5886 | 0.7107 | 0.6183 |
Financial Fraud Detection
Financial fraud detection identifies suspicious transactions, accounts, claims, and behavior to prevent losses and guide investigation.
See all 147 papers