cs.CLJun 5, 2026

ThinkBooster: A Unified Framework for Seamless Test-Time Scaling of LLM Reasoning

Authors: Vladislav SmirnovChieu NguyenSergey SenichevMinh Ngoc TaEkaterina FadeevaArtem VazhentsevDaria GalimzianovaNikolai Rozanov+9 more

Organizations: 1MBZUAI · 7Independent Researcher · 2ETH Zürich · 3Imperial College London · 6Innopolis University · 4NUS · 5Accenture

Abstract

Test-time compute (TTC) scaling has emerged as a powerful paradigm for improving large language model (LLM) reasoning by allocating additional compute during inference, e.g., via multi-sample generation and verifier-based reranking. Existing TTC scaling strategies and reasoning scorers remain fragmented, evaluated under inconsistent protocols, and are rarely analyzed through the lens of quality-cost trade-offs. We introduce ThinkBooster, a unified framework for seamless test-time compute scaling of LLM reasoning, which consists of (i) a modular Python library implementing state-of-the-art TTC scaling strategy and scorer families, (ii) a benchmark that jointly evaluates performance and computational efficiency, and (iii) a deployable OpenAI-compatible proxy service that enables drop-in integration of adaptive reasoning into real-world applications. We further provide a demo visual debugger for inspecting the reasoning trajectories, intermediate selection decisions, and alternative reasoning paths. Empirical results on mathematical and coding tasks reveal the performance-compute trade-offs of TTC scaling strategies and scoring methods and demonstrate that ThinkBooster provides practical gains in real-world tasks. The code is available online under an MIT license.

Explore similar work

CardsList