Estimating advertising performance in cold-start settings is challenging because historical logs are unavailable before launch. Large language models (LLMs) offer a potential alternative by simulating persona-conditioned user responses, but it remains unclear which design choices actually drive LLM-based persona simulation. Using real Google Ads e-commerce campaign data across five demographic segments, we identify three signal-form dimensions that affect simulation quality: (i) a demographic anchor without noisy rich attributes, (ii) a relative qualitative banner-blindness signal rather than quantitative anchors, and (iii) prompt phrasing. On this campaign, our method attains an MAE of 24.9 and a MAPE of 26.1%, a 51.3% lower MAE than the best tested non-LLM baseline and 77.3% lower than an LLM configuration using explicit CTR anchors. Systematic ablations show that minimal demographic descriptions achieve lower mean error than richer persona configurations, while relative qualitative cues substantially outperform the tested quantitative anchors. We additionally compare these configurations with direct-prior and rule-based baselines and with alternative LLM configurations.
Figures & tables
Figure 1: Overview of our LLM persona simulation framework. We examine three key dimensions of signal form that affect simulation quality: (i) a demographic anchor, (ii) a relative qualitative banner-blindness signal, and (iii) careful prompt phrasing. The LLM simulator generates repeated binary click decisions, which are aggregated into predicted CTR and predicted clicks.
Persona
Age
Gender
Parent status
Actual CTR (%)
A
45–54
Female
Parent
0.680
B
55–64
Male
Parent
0.607
C
25–34
Female
Non-parent
0.174
D
25–34
Male
Non-parent
0.200
E
35–44
Female
Parent
0.266
Table 1: Audience segments used as personas and their observed CTR over the 7-day evaluation period. All segments additionally share the same interests setting (“Shoppers”); income range is part of the base persona and is included in the prompt.
Component
Persona ( ps ): You are a user with the following demographic attributes: age range, gender, parental status, income range, and interests.
Ad creative ( a ): You are shown the following display ad, including text metadata and image.
Generic banner-blindness instruction (GBI): The “No-Click” Default: Acknowledge “Banner Blindness.” Most users ignore ads. Do not default to a positive action.
Relative banner-blindness cue: Younger adults tend to show much stronger banner blindness than older adults.
Query ( q ): Would this user click the ad? Return a binary click decision.
Table 2: Abbreviated prompt structure of our method.
Method
MAE ↓
MAPE (%) ↓
RMSE ↓
Non-LLM Baselines
Direct Prior 0.2%
51.1
37.1
73.0
Direct Prior 0.5%
66.4
93.5
75.5
Direct Prior 1.0%
176.2
252.0
198.0
Rule-based (avg)
54.5
81.7
63.8
Rule-based (weighted avg)
57.5
85.9
58.3
Table 3: Main results on 7-day evaluation (5 personas, 974,423 impressions, 3,578 clicks). Our method attains the lowest error among all tested configurations on this campaign. LLM methods report mean ± SD over 3 independent runs; non-LLM baselines are deterministic. Best values on aggregate metrics in bold . ↓ : lower is better.
Prompt
Actual clicks
Pred. clicks
Ratio
Demographics
3,578
947,516
264.82
Demographics + datetime
3,578
937,482
262.01
Rich persona
3,578
924,119
258.28
Rich persona + datetime
3,578
910,634
254.51
Table 4: Click inflation after removing the generic banner-blindness instruction. The model, persona, and simulation configurations are otherwise unchanged. Ratio =C^/C .
Persona configuration & signal
v1 MAE
v2 MAE
Relative qualitative banner-blindness
Base persona only
35.2±5.9
24.9±1.9
Base + datetime + personality
37.4±1.3
26.1±3.4
Base + datetime + personality + occupation
41.1±2.9
37.7±3.0
Explicit CTR prior (quantitative)
Base + datetime + personality + occupation
109.9±1.6
Table 5: Ablation over the three signal-form components on the 7-day evaluation. Results report mean ± SD over three independent runs. Persona granularity varies across rows and signal type across the two blocks, while the two columns report the v1 and v2 phrasings of the banner-blindness cue.
Explicit CTR Prior
Ours
Persona
Actual CTR
Pred.
Ratio
Pred.
Ratio
A (45–54 F Parent)
0.680
0.128
0.19
0.497
0.73
B (55–64 M Parent)
0.607
0.062
0.10
0.703
1.16
C (25–34 F Non-parent)
0.174
0.447
2.56
0.260
1.50
D (25–34 M Non-parent)
0.200
0.313
1.56
0.171
0.85
E (35–44 F Parent)
0.266
0.194
0.73
0.223
0.84
Table 6: Per-persona CTR calibration for our method and the Explicit CTR Prior configuration. Predicted and actual CTR are given as percentages, and the ratio CTR/CTR measures over- or under-estimation, with values closer to 1.0 indicating better calibration.
Method
CTR prior
MAE
MAPE (%)
RMSE
Direct prior
0.2%
51.1
37.1
73.0
Direct prior
0.5%
66.4
93.5
75.5
Direct prior
1.0%
176.2
252.0
198.0
Explicit CTR Prior
0.2%
82.3
76.0
99.4
Explicit CTR Prior
0.5%
109.9
127.7
112.0
Explicit CTR Prior
1.0%
129.2
169.3
153.4
Table 7: Sensitivity to CTR prior. Direct prior predicts clicks as impressions multiplied by a fixed CTR. Lower is better.
Online advertising studies how digital ads are targeted, ranked, priced, measured, and delivered while balancing budgets, business goals, and user interests.