Altered Thoughts, Altered Actions: Reasoning Chain as Control Surface for a Vision-Language-Action Policy
Organizations: University of Melbourne Parkville, VIC, Australia
Abstract
Vision-language-action policies map camera images and natural-language instructions to a robot's motor actions. Some of these policies are designed to reason in text before acting, generating a reasoning chain and decoding actions conditioned on that chain. The works introducing this design offer the reasoning chain as an oversight interface: text a person can read and edit to correct the policy. What an edited reasoning chain does to the policy's motor actions, whether it repairs them or corrupts them, remains an open question. We measure both directions, repair and corruption, with our deterministic entity swap applied to the instruction the policy receives and to the reasoning chain it generates. A forty-task observed backdrop across all four LIBERO simulation suites reveals that the cost of corrupting the reasoning chain concentrates where language alone determines the goal. There, on LIBERO-Goal, we run the decisive counterfactual intervention with DeepThinkVLA, chosen because its reasoning chain is exposed as plain text. The policy receives a corrupted instruction, paired with the reasoning chain it generates when that instruction is clean. This counterfactually correct reasoning chain recovers 47.8 pp of the lost success, our pre-registered confirmatory test. Had the chain merely restated what the camera image already determines, the injection could have changed nothing. Instead, all 10 tasks move in the predicted direction. The reasoning chain is therefore a working control surface: text written into it steers the robot, repairing behaviour when the text is right and corrupting it when the text is wrong. Whether to expose such a control surface is a real deployment tradeoff, and it can now be measured.
Figures & tables
| condition | instruction | reasoning chain |
|---|---|---|
| A | intact | generated from the clean instruction |
| B | intact | generated, then entity-swapped |
| C | entity-swapped | regenerated from the corrupted instruction |
| D | entity-swapped, identical to C | clean reasoning chain injected at every query |
| suite | scenes | tasks | goal structure | language must supply |
|---|---|---|---|---|
| LIBERO-Goal | 1 | 10 | 10 distinct goals, 4 predicate types | the goal itself |
| LIBERO-Spatial | 1 | 10 | one goal: On (bowl, plate) | which of two identical bowls |
| LIBERO-Object | 10 | 10 | one schema: In ( , basket) | which object |
| LIBERO-Long | 9 | 10 | 10 distinct goals, mostly compound | little: the scene fixes the task |
| condition | status | instruction | reasoning chain | success rate | degradation |
|---|---|---|---|---|---|
| A | observed | intact | generated | 97.3% | – |
| B | observed | intact | entity-swapped | 76.5% | 20.8 pp |
| C | observed | entity-swapped | regenerated from corrupted | 11.5% | 85.8 pp |
| D | confirmatory | entity-swapped | clean, injected | 59.3% | 38.0 pp |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| instruction | goal predicate |
|---|---|
| open the middle drawer of the cabinet | Open (cabinet middle drawer) |
| open the top drawer and put the bowl inside | In (bowl, cabinet top drawer) |
| push the plate to the front of the stove | On (plate, region in front of stove) |
| put the bowl on the plate | On (bowl, plate) |
| put the bowl on the stove | On (bowl, stove cook region) |
| put the bowl on top of the cabinet | On (bowl, cabinet top) |
| scene | instruction | goal predicates |
|---|---|---|
| kitchen 3 | turn on the stove and put the moka pot on it | Turnon (stove) On (moka pot, stove) |
| kitchen 4 | put the black bowl in the bottom drawer of the cabinet and close it | Close (cabinet bottom drawer) In (bowl, cabinet bottom drawer) |
| kitchen 6 | put the yellow and white mug in the microwave and close it | In (mug, microwave) Close (microwave) |
| kitchen 8 | put both moka pots on the stove | On (moka pot 1, stove) On (moka pot 2, stove) Turnon (stove) |
| living room 1 | put both the alphabet soup and the cream cheese box in the basket | In (alphabet soup, basket) In (cream cheese, basket) |
| living room 2 | put both the alphabet soup and the tomato sauce in the basket | In (alphabet soup, basket) In (tomato sauce, basket) |
| asset | role | provenance | licence |
|---|---|---|---|
| LIBERO | benchmark: scenes, initial states, success checks | public repository; specifications verified byte-identical to the public distribution | MIT (codebase); the demonstration datasets are CC BY 4.0 and are not used here |
| DeepThinkVLA code | evaluation and policy code | public repository, shallow clone, commit unrecorded | MIT |
| DeepThinkVLA checkpoint | the policy under study | released checkpoint, 6.9 GB in bfloat16, refactored from the public pi0-FAST checkpoint | Gemma Terms of Use, inherited through the PaliGemma backbone |
| PaliGemma backbone | SigLIP vision encoder and Gemma decoder inside the checkpoint | distributed with the checkpoint | Gemma Terms of Use (source-available, not OSI-approved) |
| robosuite 1.4.0 | simulation stack | pinned package version | MIT |
| bddl 1.0.1 | task-specification parser | pinned package version | MIT |