AlphaRLM: Aligning Language Models for Literature-Grounded Symbolic Factor Discovery
Organizations: Harbin Institute of Technology · Independent Researcher · University of Science and Technology of China
Abstract
Formulaic alpha mining seeks to discover executable expressions that capture predictive market signals in a vast, noisy search space. Recent LLM-based approaches use prompting, iterative search, or seed-factor evolution, leaving direct factor construction through policy learning less explored. To address this, we introduce AlphaRLM, a reinforcement-learning framework that trains LLMs to construct executable symbolic factors from financial literature without input factor expressions. AlphaRLM incorporates Literature-Guided Operator Assembly (LEGO), which conditions factor construction on literature-derived ideas and executable operators, providing semantic priors for exploration. It further aligns the generation policy with market feedback through executable-validity and grouped-return-separation rewards that capture non-monotonic structures across factor quantiles. Extensive experiments on CSI 300, CSI 1000, and S&P 500 show that AlphaRLM outperforms strong factor-mining and LLM-based baselines in annualized excess return. Notably, the 8B model achieves strong cross-market performance, highlighting the promise of literature-conditioned, market-aligned factor generation.
Figures & tables
| CSI 300 | CSI 1000 | S&P 500 | |||||||||||||
| Method | AR | IC | RankIC | ICIR | MDD | AR | IC | RankIC | ICIR | MDD | AR | IC | RankIC | ICIR | MDD |
| Factor Libraries | |||||||||||||||
| Alpha158 | 0.0808 0.0009 | 0.0260 0.0009 | 0.0373 0.0011 | 0.1663 0.0041 | -0.1161 0.0047 | 0.0737 0.0025 | 0.0199 0.0007 | 0.0254 0.0007 | 0.1640 0.0054 | -0.1424 0.0116 | -0.0325 0.0055 | -0.0027 0.0024 | -0.0001 0.0025 | -0.0227 0.0208 | -0.4084 0.0852 |
| Alpha360 | 0.0704 0.0033 | 0.0231 0.0017 | 0.0325 0.0005 | 0.1582 0.0138 | -0.1022 0.0099 | 0.0703 0.0007 | 0.0206 0.0013 | 0.0263 0.0007 | 0.1676 0.0113 | -0.1113 0.0050 | 0.0160 0.0060 | -0.0044 0.0021 | -0.0058 0.0009 | -0.0497 0.0248 | -0.3162 0.0688 |
| Automated Factor Mining | |||||||||||||||
| GP-Learn | 0.0815 0.0013 | 0.0185 0.0016 | 0.0271 0.0018 | 0.1181 0.0093 | -0.1132 0.0106 | 0.0965 0.0016 | 0.0259 0.0001 | 0.0368 0.0002 | 0.1918 0.0002 | -0.1727 0.0194 | -0.1301 0.0104 | -0.0016 0.0015 | 0.0028 0.0011 | -0.0120 0.0118 | -0.5591 0.0838 |
| CSI 300 | S&P 500 | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Setting | AR% | IC | RankIC | ICIR | MDD% | AR% | IC | RankIC | ICIR | MDD% |
| AlphaRLM (8B) | 12.14 | 0.026 | 0.042 | 0.159 | -6.15 | 6.94 | 0.002 | 0.003 | 0.016 | -14.84 |
| w/o DAPO | 9.66 | 0.025 | 0.034 | 0.141 | -7.58 | 3.14 | -0.001 | 0.004 | -0.004 | -30.72 |
| Non-financial text w/o DAPO | 5.24 | 0.013 | 0.035 | 0.115 | -12.99 | 1.78 | -0.003 | 0.004 | -0.022 | -26.46 |
| Non-financial text w/ DAPO | 2.13 | 0.009 | 0.031 | 0.068 | -17.59 | 2.90 | -0.008 | -0.002 | -0.063 | -28.72 |
| Linear reward | 9.68 | 0.031 | 0.042 | 0.184 | -15.60 | 0.77 | -0.002 | 0.004 | -0.028 | -19.88 |
| Factor 1: Quantile-Clipped Trading Activity per Price Movement |
| If(Gt(volume, 20, 0.95)), |
| Quantile($volume, 20, 0.95), |
| If(Lt(volume, 20, 0.05)), |
| Quantile(volume)) |
| / Abs(Delta($close, 1)) |
| Literature input: Patzelt and Bouchaud (2018) . |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Asset | Period | Trading days |
|---|---|---|
| CSI 300 | Training: 2015-01 to 2019-12 | 1219 |
| Validation: 2020-01 to 2020-12 | 243 | |
| Testing: 2021-01 to 2024-12 | 968 | |
| CSI 1000 | Training: 2015-01 to 2019-12 | 1219 |
| Validation: 2020-01 to 2020-12 | 243 | |
| Testing: 2021-01 to 2024-12 | 968 |
| Market | Factor pool | Count | AR | IC | RankIC | ICIR | MDD |
|---|---|---|---|---|---|---|---|
| CSI 300 | Alpha158 | 158 | 8.08 | 0.0260 | 0.0373 | 0.1663 | -11.61 |
| AlphaRLM-top158 | 158 | 11.95 | 0.0239 | 0.0433 | 0.1478 | -8.22 | |
| Alpha360 | 360 | 7.04 | 0.0231 | 0.0325 | 0.1582 | -10.22 | |
| AlphaRLM-top360 | 360 | 12.65 | 0.0296 | 0.0470 | 0.1840 | -7.18 | |
| CSI 1000 | Alpha158 | 158 | 7.37 | 0.0199 | 0.0254 | 0.1640 | -14.24 |
| AlphaRLM-top158 | 158 | 11.95 | 0.0327 | 0.0384 | 0.2568 | -10.51 |
| CSI 300 | CSI 1000 | S&P 500 | |||||||||||||
| Method | Mean | SD | Median | P95 | Mean | SD | Median | P95 | Mean | SD | Median | P95 | |||
| Factor Libraries | |||||||||||||||
| Alpha158 | 0.2638 | 0.2316 | 0.1924 | 0.7225 | 2.36% | 0.2651 | 0.2299 | 0.1976 | 0.7215 | 2.45% | 0.1680 | 0.2224 | 0.0742 | 0.6902 | 2.85% |
| Alpha360 | 0.4887 | 0.3176 | 0.5111 | 0.9555 | 22.75% | 0.4985 | 0.3139 | 0.5337 | 0.9549 | 23.03% | 0.4747 | 0.3568 | 0.5295 | 0.9681 | 25.52% |
| Automated Factor Mining | |||||||||||||||
| GP-Learn | 0.2819 | 0.2461 | 0.1898 | 0.8223 | 5.29% | 0.2641 | 0.2333 | 0.1832 | 0.7388 | 3.47% | 0.1793 | 0.2157 | 0.0830 | 0.7062 | 2.89% |
| Pool | Exact uniq. | Structural uniq. | Repeated factors | Max cluster | Exact library overlap | Structural library overlap |
|---|---|---|---|---|---|---|
| AlphaRLM-8B A-share | 99.9% | 95.9% | 7.2% | 5 | 0.000% | 0.104% |
| AlphaRLM-8B S&P 500 | 99.5% | 89.1% | 18.4% | 10 | 0.500% | 0.337% |
| AlphaRLM-14B A-share | 99.7% | 80.7% | 28.1% | 22 | 0.100% | 0.124% |
| AlphaRLM-14B S&P 500 | 99.9% | 92.9% | 11.9% | 9 | 0.000% | 0.000% |
| Market | Factor count | AR (%) | IC | RankIC | ICIR | MDD (%) |
|---|---|---|---|---|---|---|
| CSI 300 | 158 | 11.9469 | 0.023905 | 0.043301 | 0.147774 | -8.2226 |
| 360 | 12.6458 | 0.029587 | 0.046999 | 0.183973 | -7.1806 | |
| 1,000 | 12.1375 | 0.025554 | 0.042442 | 0.158593 | -6.1504 | |
| 1,500 | 11.1957 | 0.026342 | 0.043941 | 0.159020 | -7.4845 | |
| 2,000 | 9.0978 | 0.025492 | 0.043189 | 0.155702 | -7.4613 | |
| CSI 1000 | 158 | 11.9513 | 0.032682 | 0.038445 | 0.256770 | -10.5107 |
| CSI 300 | CSI 1000 | S&P 500 | |||||||||||||
| Method | AR | IC | RankIC | ICIR | MDD | AR | IC | RankIC | ICIR | MDD | AR | IC | RankIC | ICIR | MDD |
| Factor Libraries | |||||||||||||||
| Alpha158 | 0.0624 | 0.0152 | 0.0333 | 0.0891 | -0.1357 | 0.0734 | 0.0010 | 0.0164 | 0.0074 | -0.1500 | -0.1358 | -0.0013 | 0.0017 | -0.0092 | -0.6318 |
| Alpha360 | 0.0175 | 0.0082 | 0.0209 | 0.0377 | -0.2501 | -0.0259 | 0.0065 | 0.0303 | 0.0489 | -0.2241 | -0.1864 | -0.0173 | -0.0191 | -0.1343 | -0.8209 |
| Automated Factor Mining | |||||||||||||||
| GP-Learn | 0.0150 | 0.0049 | 0.0068 | 0.0280 | -0.2109 | 0.0870 | 0.0166 | 0.0365 | 0.1208 | -0.1761 | -0.0758 | -0.0042 | 0.0040 | -0.0247 | -0.4063 |
Quantitative Finance
Quantitative finance uses mathematical models, statistics, and machine learning to value assets, measure risk, and guide trading and portfolio decisions.
See all 191 papers