aDSL: Agentic 3D Creation via Joint Agent-Program Design
Organizations: Peking University, China
Abstract
Programmatic representations provide a compelling paradigm for 3D content creation, enabling fine-grained edits, interpretability, and explicit structural control. Yet, agentic workflows that rely on large language models (LLMs) to author 3D programs remain brittle, often failing to translate high-level intent into consistent low-level geometry. We attribute this fragility to a mismatch between existing programmatic interfaces and the reasoning strengths of LLMs, which favor semantic structure and spatial relations over fragile numeric choices. In this paper, we jointly design an Agent-centric Domain-Specific Language (aDSL) and a role-specialized multi-agent system to close this gap. aDSL bridges semantic logic and geometric constraints by emphasizing composability and spatial reasoning; it enables agents to manipulate geometry through relational operators instead of brittle absolute coordinates. Building on aDSL, our training-free multi-agent system follows a Plan-Execute-Critic loop to decompose requests, synthesize code, and iteratively repair errors and constraint violations using execution feedback. Experiments show that this co-design improves robustness, controllability, and faithfulness to user intent. Our method outperforms prior LLM-based baselines on text-to-shape and image-to-shape tasks while preserving explicit structure, editability, and interpretability. It also enables downstream applications such as articulated object creation and structured scene composition. Our code is available at https://github.com/sig-pku/aDSL.
Figures & tables
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Type or operator family | Public interface and semantics |
|---|---|
| P , T , Asset | 3D vectors, transforms, and hierarchical geometry containers with uniquely named direct parts. |
| attach_part , detach_part , copy , concat_shapes | Construct, revise, copy, and combine explicit asset hierarchies. |
| Cube/cube , Sphere/sphere , Cylinder/cylinder | Equivalent capitalized and lowercase primitive constructors; cylinders accept either endpoints or a height and cardinal axis. |
| boolean_union , boolean_intersection , boolean_difference , boolean_xor | Constructive solid geometry operators that retain operand hierarchy. |
| translation_matrix , scaling_matrix , rotation_matrix | Matrix constructors; positive axis–angle rotations obey the right-hand rule. |
| transform_shape , translate_shape , scale_shape , rotate_shape | Return transformed copies; rotation supports axis–angle and Euler forms. |
LLM-Based Program Synthesis
Large language model (LLM)-based program synthesis turns natural-language goals and examples into executable programs, often using tests or formal constraints.
See all 307 papers