Reasoning capabilities in large language models have evolved from prompting-based methods to internalized model behaviors. In this paper, we investigate whether the internal thinking model of an LLM can be deliberately changed and whether such a change is beneficial. Instead of relying on Chain-of-Thought, we train models to follow Question--Option--Criteria (QOC), a structured decision process that decomposes a task into explicit questions, competing options, and evaluation criteria. We present a three-generation development pipeline that ranges from a basic QOC decision core to richer answer synthesis and statistically enriched QOC reasoning. We then evaluate the resulting models with respect to both internal consistency and output quality. Across the reported experiments, QOC-based fine-tuning improves answer quality relative to non-fine-tuned base models and yields particularly strong gains once models are large enough to execute the underlying QOC computations reliably. The results suggest that the internal thinking model of an LLM is trainable and that structured alternatives to Chain-of-Thought can provide a promising path toward more reliable, interpretable, and task-adapted decision support.
Figures & tables
Figure 1: Generation 1 pipeline creates synthetic decision tasks, applies structured QOC analysis to identify the best option, and outputs this best option directly.
Figure 2: Generation 2 architecture integrates a second-stage interpretation module synthesizes a richer natural-language response grounded.
Figure 3: Generation 3 pipeline extends the QOC decision core by incorporating statistical enrichment.
Figure 4: Implementation pipeline of the QOC-based training workflow.
Model
Correct
Correct Options
Wrong Options
Qwen-3.5-0.8B-QOC
2
19 (3.75%)
488 (96.25%)
Qwen-3.5-2B-QOC
15
298 (63.54%)
171 (36.46%)
Qwen-3.5-4B-QOC
65
449 (88.91%)
56 (11.09%)
Qwen-3.5-9B-QOC
87
474 (97.33%)
13 (2.67%)
Qwen-3.5-27B-QOC
95
490 (98.99%)
5 (1.01%)
Table 1: Internal consistency of QOC-based fine-tuned Qwen3.5 models
Fine-tuned model
27B
9B
4B
2B
0.8B
Qwen-3.5-27B-QOC
61 ∗
—
—
—
—
Qwen-3.5-9B-QOC
53
79 ∗
—
—
—
Qwen-3.5-4B-QOC
49
81 ∗
82 ∗
—
—
Qwen-3.5-2B-QOC
35 †
62 ∗
66 ∗
87 ∗
—
Qwen-3.5-0.8B-QOC
12 †
31 †
26 †
71 ∗
98 ∗
Table 2: LLM-as-a-Judge preferences for fine-tuned QOC models over non-fine-tuned base models.
Model
BT score
95% CI
Qwen-3.5-27B-QOC
6.435
[4.939, 7.932]
Qwen-3.5-4B-QOC
6.091
[4.643, 7.539]
Qwen-3.5-9B-QOC
6.086
[4.623, 7.549]
Qwen-3.5-27B
5.988
[4.546, 7.430]
Qwen-3.5-2B-QOC
5.282
[3.844, 6.720]
Qwen-3.5-9B
4.727
[3.293, 6.161]
Table 3: Bradley–Terry scores for base and fine-tuned QOC models