RetailAgent: Structured Adverse Timing in Self-Conditioned Multimodal LLM Trading Agents
Organizations: University of Wisconsin–Madison · University of Rochester · Michigan State University
Abstract
In financial markets, a sequential policy that reacts systematically to price movements may become predictable to other market participants. This paper studies whether large language model (LLM) agents exhibit such directional structure through RetailAgent, an experimental framework in which an LLM observes anonymized intraday equity price histories and permitted state, then repeatedly chooses long (hold the stock) or flat (stay out) before the subsequent interval return is revealed. We compare returns during long and flat intervals along the same stock's intraday path after removing the overall fraction of long decisions. This exposure-matched measure reveals persistent negative timing across modality, horizon, state, and model family. Shuffling saved action sequences substantially attenuates the effect, showing that alignment between actions and subsequent returns drives the negative score. Feeding self-authored memories into decisions further increases policy persistence, while timing becomes more negative among stock-days on which the agent uses both actions. These results reveal stable, recoverable directional structure in sequential LLM financial decisions and a behavioral signal for studying how another participant could respond to a predictable policy.
Figures & tables
| Model or control | Observation or state | Interval | Stock-days | Timing alpha, bps (95% CI) | Switches |
| A. Fourteen standard configurations | |||||
| Qwen3.5 | price text | 10m | 13,710 | ||
| Qwen3.5 | chart | 10m | 14,937 | ||
| Qwen3.5 | multimodal | 10m | 14,438 | ||
| Qwen3.5 | price text | 20m | 23,594 | ||
| Qwen3.5 | +position | 20m | 25,410 | ||
| Comparator | Stock-days | Corr. with | Inverted | Residual timing (95% CI) |
|---|---|---|---|---|
| GRU price model | 2,519 | |||
| GBDT-38 | 13,717 | |||
| One-period reversal | 13,717 |
| Self-conditioning condition | Scored | Timing alpha (95% CI) | IC (95% CI) |
|---|---|---|---|
| No directive, | 1,289 | ||
| Conviction, | 1,011 | ||
| Consistency, current only ( ) | 1,194 | ||
| Consistency, one earlier ( ) | 1,054 | ||
| Consistency, | 1,154 | ||
| Consistency, | 1,184 |
| Conventional | Self-conditioning | |||
|---|---|---|---|---|
| Metric pair | Pearson | Spearman | Pearson | Spearman |
| Timing vs portfolio return | ||||
| Timing vs cross-sectional IC | ||||
| Portfolio return vs cross-sectional IC | ||||
| Configuration | Timing score, bps (95% CI) |
|---|---|
| Shared centered-outcome group | |
| Soft tokens disabled | |
| Two tokens, 92-word basis | |
| Eight tokens, 92-word basis | |
| Sixteen tokens, 92-word basis | |
| Two tokens, 492-word basis | |
| Condition | Long intervals | Exposure | Long return | Flat return | Timing alpha |
|---|---|---|---|---|---|
| Price text | |||||
| Consistency, one earlier memory |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Narrative condition | Failed intervals | Affected cells | Constant paths | Scored |
|---|---|---|---|---|
| No directive, | 1,120 | 641 | 211 | 1,289 |
| Conviction, | 1,690 | 584 | 489 | 1,011 |
| Consistency, | 1,581 | 925 | 306 | 1,194 |
| Consistency, | 1,545 | 615 | 446 | 1,054 |
| Consistency, | 505 | 344 | 346 | 1,154 |
| Consistency, | 266 | 207 | 316 | 1,184 |
Algorithmic Trading
Algorithmic trading uses computational models to generate signals, allocate portfolios, and execute orders across financial markets.
See all 149 papers