SCOPE: Scene-graph Construction Optimized by Plan Error-correction for Robot Long-term Planning Datasets
Organizations: State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing 100190, China. · School of Artificial Intelligence, University of Chinese Academy of Sciences (UCAS), Beijing 100049, China.
Abstract
Task and Motion Planning (TAMP) stands as a fundamental challenge in robotics, essential for enabling autonomous agents to execute complex, long-horizon tasks in diverse environments. While Large Language Models (LLMs) introduce a new paradigm for TAMP by leveraging extensive common sense, their inherent reasoning limitations hinder direct application, and fine-tuning strategies to enhance these capabilities are currently bottlenecked by the scarcity of high-quality datasets. Existing automated generation methods often suffer from homogeneity, limiting model generalization, and unsolvability, where hallucinated scene graphs create physical mismatches with task goals. To address these issues, we propose Scene-graph Construction Optimized by Plan Error-correction (SCOPE), an automated framework designed to generate diverse and executable TAMP datasets. SCOPE incorporates multi-level diversity metrics to maximize the information entropy of scenarios. Crucially, it introduces a Plan Feedback Error-correction pipeline that utilizes planner execution failures as feedback signals to retroactively rectify logical inconsistencies in scene graphs, ensuring physical feasibility. Experimental results demonstrate that SCOPE exhibits greater robustness to erroneous scene graphs and generates higher-quality data. When utilized for LLM fine-tuning, SCOPE-generated data yield a downstream TAMP model that achieves an absolute 12.33% gain in success rate over its counterpart fine-tuned with data generated by DELTA, a state-of-the-art PDDL-based planner.
Figures & tables
| Methods | Overall | Simple Tasks | Complex Tasks | Vague Tasks | ||||||||
| AQS | SR | EX | AQS | SR | EX | AQS | SR | EX | AQS | SR | EX | |
| LLM-As-Planner [ 6 ] | 1.84 | 27.00% | 29.67% | 2.27 | 46.00% | 46.00% | 1.78 | 18.00% | 21.00% | 1.47 | 17.00% | 22.00% |
| LLM+P [ 7 ] | 1.76 | 41.67% | 48.00% | 2.68 | 67.00% | 67.00% | 1.41 | 30.00% | 39.00% | 1.18 | 28.00% | 38.00% |
| LLMGenPlan (w/o rp.) | 0.40 | 6.33% | 36.67% | 0.61 | 12.00% | 45.00% | 0.36 | 4.00% | 34.00% | 0.22 | 3.00% | 31.00% |
| LLMGenPlan [ 17 ] | 1.24 | 23.00% | 61.33% | 1.83 | 42.00% | 70.00% | 1.14 | 14.00% | 67.00% | 0.76 | 13.00% | 47.00% |
| DELTA [ 18 ] | 2.25 | 46.33% | 67.00% | 2.86 | 69.00% | 74.00% | 1.94 | 31.00% | 68.00% | 1.94 | 39.00% | 59.00% |
| Methods | Div. | Corr. | Overall | Simple Tasks | Complex Tasks | Vague Tasks | ||||||||
| AQS | SR | EX | AQS | SR | EX | AQS | SR | EX | AQS | SR | EX | |||
| LLM-As-Planner [ 6 ] | ✗ | ✗ | 1.57 | 25.00% | 26.00% | 2.43 | 54.00% | 54.00% | 1.36 | 10.00% | 11.00% | 0.91 | 11.00% | 13.00% |
| DELTA [ 18 ] | ✗ | ✗ | 2.67 | 50.67% | 77.67% | 3.47 | 83.00% | 90.00% | 2.23 | 28.00% | 74.00% | 2.31 | 41.00% | 69.00% |
| SCOPE | ✓ | ✗ | 3.03 | 59.67% | 87.00% | 3.62 | 87.00% | 93.00% | 2.66 | 40.00% | 86.00% | 2.81 | 52.00% | 82.00% |
| SCOPE | ✗ | ✓ | 2.96 | 58.00% | 81.00% | 3.60 | 86.00% | 93.00% | 2.65 | 41.00% | 71.00% | 2.64 | 47.00% | 79.00% |
| SCOPE | ✓ | ✓ | 3.08 | 63.00% | 85.33% | 3.61 | 88.00% | 93.00% | 2.83 | 50.00% | 83.00% | 2.81 | 51.00% | 80.00% |
Synthetic Data Generation for Robotics
Synthetic data generation for robotics creates simulated scenes, sensor readings, and action trajectories to train and evaluate robots.
See all 303 papers