Synthetic Data Generation for Robotics

Overview

This field studies how to create useful robot-training and evaluation data without collecting every example on physical hardware, supporting tasks from manipulation and navigation to humanoid motion and tactile sensing. Common approaches include physics-based simulators with procedural scenes and domain randomization, automated trajectory planning, retargeting human demonstrations, and generative video or world models that produce observations paired with actions. Researchers test these methods in settings such as tabletop manipulation, deformable-object handling, and navigation, often measuring transfer to real robots as well as performance on simulation benchmarks. The central tension is scaling data and visual diversity while keeping scenes, sensor signals, and actions physically consistent; realistic-looking outputs alone do not guarantee useful training data or reliable sim-to-real transfer.

Latest papers

CardsList

327 papers31 papers in the last four weeks, down 43% on the four weeks before. 0.2% of all new papers.

  1. RFW-S: Everyday Deformable Objects with Independent Simulation Verification

    Nov 17, 2026Jiarui Guo, Saining Zhang, Jiaying Wan +15Synthetic Data Generation for RoboticsDeformable Object Simulation

  2. Talk to Act: A Synthetic Multi-Turn Dialogue Benchmark for Human Intent Extraction and Action Planning in Robotics

    Nov 12, 2026Deepu Krishnareddy, Mohammad Haziq Khan, Michael Danner +1Human-Robot InteractionLarge Language Model-Based Robot Planning

  3. Agentic-Teacher: An Agentic Data Engine for Failure-Driven VLA Post-Training

    Nov 12, 2026Gongyue Teng, Yuqing Xie, Yixian Zhang +10VLA Model TrainingVision-Language-Action Models

  4. Reading the Table: Sim-to-Real Game State Detection for the Chef's Hat Card Game

    Nov 11, 2026Connor Gäde, Matthias Kerzel, Hauke Bünning +3Robotic PerceptionState Tracking

  5. Augmentron: Scalable Multi-View Visual Augmentation for Robot Learning

    Nov 6, 2026Tanay Tandon, Aseem Doriwala, Jade Choghari +2Data AugmentationSynthetic Data Generation for Robotics

  6. MOMASPLAT: Dynamic Novel-View Demonstration Augmentation for Mobile Manipulation

    Nov 5, 2026Sateesh Kumar, Arnav Balaji, Arpit Bahety +3Mobile ManipulationRobotic Manipulation

  7. Perceptive Humanoid Motion from Simulation

    Nov 4, 2026Siyuan Hu, Abulikemu Abuduweili, Yue Meng +5Humanoid RoboticsSim-to-Real Transfer

  8. Hybrid Particle-Voxel Dynamics for Multimodal 3D World Simulation

    Nov 3, 2026Jimmy Wang, Yifan Chou, Kaifeng Zhang +5World Models for Robotics3D Scene Prediction

  9. ClothDojo: Learned Data Generation and Benchmarking for Bimanual Garment Flattening and Folding

    Oct 31, 2026Zilong Huang, Zipeng Ye, Caicheng Wang +2Robotic ManipulationSynthetic Data Generation for Robotics

  10. Movens-Zero: Scaling Humanoid Motion Foundation Models with Large-Scale Human Videos

    Oct 30, 2026Wendong Bu, Tinghong Ye, Qizhou Wang +21Human Motion GenerationMultimodal Generation

  11. RFW-A: Agentic Procedural Generation of 400K Articulated Assets over 500 Categories

    Oct 29, 2026Yuanbo Lyu, Changjian Pan, Saining Zhang +19Articulated 3D Asset GenerationSynthetic Data Generation for Robotics

  12. Generating Critic-Guided Synthetic Experience in Latent World Models

    Oct 29, 2026Jorge de Freitas, Christos Ziakas, Alessandra RussoModel-Based RLOffline RL

  13. RynnWorld-Latent: A Cross-Embodiment World Model Conditioned on Universal Latent Actions

    Oct 27, 2026Haoyu Zhao, Yinzhou Tang, Zixuan Wang +11Embodied World ModelsWorld Models

  14. RoboSTD: Zero-Shot Single-to-Dual Transfer via Sagittal Mirroring for Bimanual Learning

    Oct 27, 2026Hongyu Wu, Chong Liu, Shaoxuan Xie +4Bimanual Robotic ManipulationRobot Imitation Learning

  15. Robot-Aligned 3D Gaussian Splatting for Precise Reaching with Wrist-Camera VLA Policies

    Oct 26, 2026Zuoxu Wang, Xiao LiangRobotic ManipulationSynthetic Data Generation for Robotics

  16. Zero-HLM: Generalizable Humanoid Loco-Manipulation without Real Robot Data

    Oct 26, 2026Dianyi Yang, Mengya Liu, Zhumei Wang +9Humanoid Loco-ManipulationSim-to-Real Transfer

  17. One Scan is Enough: Demonstration-Free Adaptation for Language-Guided Navigation

    Oct 24, 2026Zhuoyuan Yu, Yuxing Long, Du Wang +3Vision-Language NavigationRobot Policy Adaptation

  18. RoboReason: Boosting Robotics-Relevant VLM Reasoning Through Scalable Data Generation

    Oct 24, 2026Sagnik Anupam, Utkarsh Lal, Aneesh Edara +5VLMs for RoboticsVisual Reasoning

  19. SCOPE: Scene-graph Construction Optimized by Plan Error-correction for Robot Long-term Planning Datasets

    Oct 22, 2026Chaoyue Li, Zeyu Gao, Yanfeng Lu +1Synthetic Data Generation for RoboticsRobot Task Planning