cs.ROMay 20, 2026

Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs

Authors: Abhinaw PriyadershiJelena Frtunikj

Organizations: NVIDIA Corporation, USA · NVIDIA GmbH, Germany

Abstract

Interpretable autonomous driving planners depend not only on generating explanations, but also on those explanations remaining reliable under real-world sensor degradation. In this paper we present a controlled perturbation study of Vision-Language-Action (VLA) robustness in autonomous driving, evaluating Alpamayo R1 (10B parameters) across 1,996 scenarios under eight sensor perturbations (Gaussian noise at four intensities, two lighting extremes, and two fog levels; 18,000{\sim}18{,}000 inference trials). We find that reasoning consistency is a high-fidelity indicator of trajectory reliability: when Chain-of-Causation (CoC) explanations change after perturbation, trajectory deviation spikes 5.3×5.3{\times} (21.8m vs 4.1m), with r ⁣= ⁣0.99r\!=\!0.99 across attack types and rpb ⁣= ⁣0.53r_{pb}\!=\!0.53 per-sample (Cohen's d ⁣= ⁣1.12d\!=\!1.12). A controlled ablation provides evidence that enabling CoC generation is associated with improved trajectory accuracy (11.8% on average across conditions; p<0.0001p < 0.0001) under matched inference settings. Over the tested noise range (σ{10,30,50,70}σ\in \{10, 30, 50, 70\}), degradation is approximately linear (R2 ⁣= ⁣0.957R^2\!=\!0.957), while standard input preprocessing defenses provide only marginal relief. Together, these results establish CoC consistency as a quantitative proxy for planning safety and motivate reasoning-based runtime monitoring for safer VLA deployment.

Explore similar work

CardsList