cs.ROMar 8, 2026

HSC-VLA: Hierarchical Scene-Clearing for Robust Bimanual Manipulation in Dense Clutter

Authors: Zhen Liu, Xinyu Ning, Zhe Hu, XinXin Xie, Yitong Liu, Zhongzhu Pu

Organizations: Beijing University of Posts and Telecommunications · InspireOmni AI · Tsinghua University

Abstract

Modern Vision--Language--Action models often suffer from critical instruction-following failures in high-density manipulation environments, where task-irrelevant visual clutter dilutes attention, corrupts grounding, and substantially degrades performance in complex long-horizon scenarios. To overcome the representation bottleneck of monolithic end-to-end architectures, we propose HSC-VLA, a hierarchical framework that decouples high-level visual-semantic reasoning from low-level, high-frequency sensorimotor execution through an explicit scene-clearing abstraction. HSC-VLA employs a high-level Brain to decompose long-horizon tasks and to generate task-specific scene masks that preserve task-relevant geometry while suppressing distractors. The filtered observations are then passed to a low-level Cerebellum, a diffusion-based policy that performs bimanual manipulation using only mask-filtered vision and proprioception. Extensive experiments in densely cluttered supermarket shelves demonstrate that HSC-VLA achieves 86.7% aggregate success under high-density clutter, surpassing the best monolithic baseline (π0π_0-Full FT at 34.3%) by 52.4%. HSC-VLA also exhibits strong long-horizon performance, reaching 72% on clutter sorting and 66% on restocking, demonstrating strong robustness and effective failure recovery in complex cluttered manipulation.

Figures & tables

Explore similar work

CardsList
  1. Overcoming Visual Clutter in Vision Language Action Models via Concept-Gated Visual Distillation

    Mar 11, 2026Sangmim Song, Sarath Kodagoda, Marc Carmichael +1Vision-Language-Action ModelsRobustness of VLA Models

  2. Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection

    Apr 15, 2026Zhen Liu, Xinyu Ning, Zhe Hu +8Long-Horizon Robotic ManipulationRobot Task Planning

  3. H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space

    Sep 19, 2026Xiongfeng Peng, Lu Xu, Yandong Wang +10Vision-Language-Action ModelsLanguage-Conditioned Robot Manipulation