cs.CLOct 7, 2026

From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery

Authors: Xinglin Wang, Zishen Liu, Tong Zheng, Shaoxiong Feng, Peiwen Yuan, Yiwei Li, Jiayi Shi, Yueqi Zhang, +4 more

Organizations: Beijing Institute of Technology · Xiaohongshu Inc

Abstract

Test-time scaling (TTS) improves the reasoning capabilities of large language models by allocating additional inference computation. Existing approaches to improving TTS efficiency largely optimize accuracy against one resource dimension at a time, advancing either the accuracy--cost or accuracy--latency Pareto frontier. Yet user requirements are multidimensional: users may specify accuracy, latency, and inference-cost requirements jointly, and different requirements can favor different controllers. We formulate Personalized Test-Time Scaling as discovering executable controllers that maximize the joint satisfaction rate of user-specific requirements. To reduce the overhead of repeated policy discovery for new user profiles, we propose PersonTTS, an amortized agentic policy-discovery framework that reuses prior search experience through requirement-matched controller initialization and source-distilled procedural guidance, while retaining target-profile evaluation for every candidate. Experiments on AIME and HMMT show that PersonTTS substantially outperforms strong TTS baselines in joint requirement satisfaction on unseen user profiles and held-out problems. Under the same candidate-evaluation budget, cross-user experience reuse further improves policy quality while substantially reducing discovery-agent time and cost.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling

    May 8, 2026Tong Zheng, Haolin Liu, Chengsong Huang +10Test-Time ScalingAgentic Discovery

  2. Share More, Search Less: Collaborative Parallel Thinking for Efficient Test-Time Scaling

    May 26, 2026Xinglin Wang, Hao Lin, Shaoxiong Feng +9Test-Time ScalingTest Time