CoT Compression
CoT: Chain-of-Thought
Overview
Chain-of-thought compression studies how to make language models reason with fewer generated tokens or less computation without losing the information needed to solve a task. Approaches include pruning low-utility tokens or segments, reinforcement learning with adaptive length rewards, distilling concise traces, and replacing explicit steps with latent representations or reusable memory. Methods are commonly tested on mathematical reasoning benchmarks such as GSM8K, MATH, and AIME, as well as science, general-knowledge, and agent tasks. The central tension is that shorter traces can preserve accuracy in many settings, but aggressive or poorly targeted compression may harm difficult reasoning, reliability, or trustworthiness.
Latest papers
58 papers4 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.