cs.AINov 7, 2025

CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization

Authors: Ziqian Bi, Yinzhi Wang, Tianyang Wang, Junfeng Hao, Benji Peng, Wenqian Weng, Jiayi Gu, Jacqueline Pang, +1 more

Organizations: 1Purdue University, USA · 2Baruch College, City University of New York, USA · 3The Ohio State University, USA · 4AI Agent Lab, USA · 5Appcubic, USA · 6Wayne State University, USA · 7Central University of Finance and Economics, China · 8Cornell University, USA · 9Emory University, USA

Abstract

Long Chain-of-Thought (CoT) traces can improve reasoning accuracy, but repeatedly generating them is costly for smaller or latency-constrained language models. This paper studies a practical alternative: produce a rich rationale once with a capable \emph{thinking} model, compress it, and reuse the compressed trace as context for a cheaper \emph{answering} model. We introduce CoT-X, an adaptive framework for cross-model CoT transfer. CoT-X segments reasoning traces into semantic units, scores their diagnostic and logical importance, selects budget-feasible evidence paths, and reconstructs a coherent compressed rationale for the answering model. On 7,5017,501 Japanese medical licensing questions spanning 1010 specialties, CoT-X improves accuracy over direct truncation by up to 40.5%40.5\% under the same token budget, with the largest gains at 6464--256256 tokens. Across 6464 thinking--answering pairs from eight DeepSeek-R1 and Qwen3 models (1.5B--32B parameters), reasoning transfer is most reliable within a model family, yet remains effective across families once compression normalizes the trace. A Gaussian Process Bayesian optimization layer finds near-optimal model--budget configurations with 1515 evaluations rather than an exhaustive search over all 6464 pairs, reducing evaluation cost by 84%84\%. These results show that reasoning quality, token budget, and model compatibility can be optimized jointly, making CoT-style reasoning more practical under realistic deployment constraints.

Explore similar work

CardsList