IDfRA: Self-Verification for Iterative Design in Robotic Assembly
Organizations: Institute for Manufacturing, Department of Engineering, University of Cambridge
Abstract
Design for Robotic Assembly (DfRA) remains largely dependent on manual planning and heuristic simulation, limiting scalability and robustness in complex industrial settings. Although large language models (LLMs) show promise for semantic reasoning and task planning, most approaches remain tightly coupled to pre-built simulators that assume an accurate world model. We introduce Iterative Design for Robotic Assembly (IDfRA), a closed-loop framework that combines an LLM for plan generation with a vision-language model (VLM) for execution assessment. Given a target structure and a partial environmental signature, the LLM proposes an assembly plan, the robot executes it once at test time, and the VLM evaluates the resulting state to provide feedback for replanning. Through this iterative planning-execution-verification loop, the system progressively improves semantic fidelity and physical feasibility. Crucially, IDfRA does not require an accurate a priori world model before deployment. Instead, physical constraints are discovered online through interaction, enabling adaptation to under-specified environments. Empirical evaluation demonstrates that IDfRA attains 73.3% top-1 accuracy in semantic recognisability, surpassing the baseline on this metric. Moreover, the resulting assembly plans exhibit robust physical feasibility, achieving an overall 86.9% construction success rate, with design quality improving across iterations, albeit not always monotonically. Pairwise human evaluation further corroborates the advantages of IDfRA relative to alternative approaches. By integrating self-verification with context-aware adaptation, the framework evidences strong potential for deployment in unstructured manufacturing scenarios.
Figures & tables
| N | Method | Top-1 Acc. | Average Ranking | Relative Ranking |
|---|---|---|---|---|
| 5 | Iterative DfRA | 64.44% | 1.60 | 32.00 % |
| BloxNet | 62.22% | 1.62 | 32.44% | |
| 10 | Iterative DfRA | 73.33% | 2.24 | 22.44% |
| BloxNet | 57.78% | 2.38 | 23.78% | |
| 15 | Iterative DfRA | 68.89 % | 2.71 | 18.07 % |
| BloxNet | 51.11% | 3.36 | 22.37% |
| Assembly Design | % Blocks Correctly Placed | % Assemblies Successful |
|---|---|---|
| Giraffe | 97.78 | 80 |
| Taj Mahal | 100 | 100 |
| House | 100 | 100 |
| Shark | 95 | 70 |
| Burger | 100 | 100 |
| Jungle | 95.71 | 70 |
| VLM Recognisability (N = 10) | Containing Missing Blocks | |||
|---|---|---|---|---|
| Top-1 Acc. | Average Rank | # targets | # iterations | |
| Proposed IDfRA | 94.44 % | 1.05 | 2 | 10 |
| PNG instead of GIF | 72.22% | 1.61 | 2 | 9 |
| No missing blocks | 66.67% | 2.22 | 3 | 11 |
| No history | 83.33% | 2.05 | 4 | 5 |
Robotic Assembly
Robotic assembly studies how robots perceive, plan, and join parts reliably, from precision insertion to collaborative construction.
See all 88 papers