cs.RONov 9, 2026

SPARK: Simple Post-training for Adapting pRetrained Knowledge to Robot Control

Authors: Taekyung Kim, Jeongeun Park, Byeongho Heo, Sungjoon Choi, Sangdoo Yun, Dongyoon Han

Organizations: NAVER AI Lab · Georgia Institute of Technology · Korea University

Abstract

Large-scale representation learning has produced public foundation models that provide strong general-purpose visual features. However, their pretraining objectives are not designed for robot representation learning, so the resulting embeddings tend to emphasize global semantics rather than the temporally sensitive representations required for robot control. Training robot models from scratch is also undesirable due to the limited scale and high collection cost of robotics data, as well as the substantial computational burden of pre-training. In this paper, we propose SPARK (Simple Post-training for Adapting pRetrained Knowledge), a post-training method that adapts foundation models to robot control. SPARK is built on two principles: temporal abstraction, which encourages the encoder to derive compact features that preserve information essential for understanding temporal changes and action-relevant scene structure, and knowledge preservation, which aligns patch-level representations with those of the original foundation model to retain useful pretrained semantics. These objectives yield compact visual state representations that remain semantically meaningful while preserving useful prior knowledge. Experiments across multiple robotics benchmarks show that SPARK consistently improves success rates and generalization over vanilla foundation models, and further demonstrate that these gains transfer to real-world robot manipulation.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. STORM: Slot-based Task-aware Object-centric Representation for robotic Manipulation

    Jan 28, 2026Alexandre Chapin, Emmanuel Dellandréa, Liming ChenVision Foundation Model AdaptationGeneralization in Robotic Manipulation

  2. ARC: A Reasoning Recipe for Robot Foundation Models

    Oct 8, 2026Gokul Puthumanaillam, Tao Sun, Elie Aljalbout +5Robot Foundation ModelsReasoning for VLA Models

  3. RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation

    May 25, 2026Wenhui ChuVision Foundation Model AdaptationRobotic Manipulation