PR-CAD: Progressive Refinement for Unified Controllable and Faithful Text-to-CAD Generation with Large Language Models
Organizations: National Language Resources Monitoring and Research Center for Print Media, Beijing Language and Culture University, China · School of Information Science, Beijing Language and Culture University, China · School of Computer Science and Technology, Beijing Jiaotong University, China · School of Computer Science and Engineering, Northeastern University, China ·
Abstract
The construction of CAD models has traditionally relied on labor-intensive manual operations and specialized expertise. Recent advances in large language models (LLMs) have inspired research into text-to-CAD generation. However, existing approaches typically treat generation and editing as disjoint tasks, limiting their practicality. We propose PR-CAD, a progressive refinement framework that unifies generation and editing for controllable and faithful text-to-CAD modeling. To support this, we curate a high-fidelity interaction dataset spanning the full CAD lifecycle, encompassing multiple CAD representations as well as both qualitative and quantitative descriptions. The dataset systematically defines the types of edit operations and generates highly human-like interaction data. Building on a CAD representation tailored for LLMs, we propose a reinforcement learning-enhanced reasoning framework that integrates intent understanding, parameter estimation, and precise edit localization into a single agent. This enables an "all-in-one" solution for both design creation and refinement. Extensive experiments demonstrate strong mutual reinforcement between generation and editing tasks, and across qualitative and quantitative modalities. On public benchmarks, PR-CAD achieves state-of-the-art controllability and faithfulness in both generation and refinement scenarios, while also proving user-friendly and significantly improving CAD modeling efficiency.
Figures & tables
| Method | Generation Task | Editing Task | ||||||
| Quantitative | Qualitative | Quantitative | Qualitative | |||||
| IR ↓ | Mean CD ↓ | IR ↓ | VLM-Eval ↑ | IR ↓ | Mean CD ↓ | IR ↓ | VLM-Eval ↑ | |
| GPT-4o (zero-shot) | 74.22 | 133.52 | 66.48 | 55.85 | 25.81 | 23.30 | 27.76 | 61.01 |
| GPT-4o (few-shot) | 55.95 | 77.49 | 49.24 | 58.91 | 15.47 | 15.52 | 13.47 | 66.18 |
| Text2CAD | 0.97 | 27.68 | 3.41 | 66.35 | ✗ | ✗ | ✗ | ✗ |
| Text-to-CadQuery | 6.62 | 11.32 | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| Interaction Method | Experts | Novices | ||||||
| Success Rate | Avg. Turns | Avg. Time | SUS | Success Rate | Avg. Turns | Avg. Time | SUS | |
| Single-turn Generation | 56.25% | 1 | 6’48” | 38.125 | 31.25% | 1 | 9’27” | 25.125 |
| Multi-turn Interaction | 100% | 3.375 | 3’24” | 93.125 | 81.25% | 4.53 | 5’16” | 80.625 |
| Training Strategy | IR | Mean CD | Median CD | VLM-Eval |
| Qwen2.5-7B | ✗ | ✗ | ✗ | ✗ |
| Qwen2.5-7B w/o SFT | ✗ | ✗ | ✗ | ✗ |
| Qwen2.5-7B w/o RL | 12.67 | 84.63 | 6.54 | 56.44 |
| Qwen2.5-7B w/o SCoT | 2.48 | 11.34 | 2.08 | 68.81 |
| Qwen2.5-7B t/o/o Generation | 9.45 | 42.07 | 5.49 | 60.56 |
| Qwen2.5-7B t/o/o Editing | 6.94 | 20.05 | 1.90 | 65.54 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Text-to-CAD Generation
Text-to-CAD generation turns natural-language design intent into executable, editable parametric 3D models and assemblies.
See all 48 papers