cs.AIAug 6, 2026

iARCS: Iterative Agentic RL for Controllable 3D Scene Generation

Authors: Saugat AdhikariAshok Prasad NeupanePramish PaudelAjad ChhatkuliDanda Pani Paudel

Organizations: Pulchowk Campus, IOE, Tribhuvan University, Lalitpur, Nepal · INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria · NAAMII, Kathmandu, Nepal

Abstract

Synthetic 3D scene generation is increasingly used as a data source for computer vision and embodied AI, but existing generators often optimize perceptual realism without reliably satisfying task-critical functional constraints. This mismatch limits the usefulness of synthetic data for downstream training, where accessibility, traversability, and spatial rule compliance are often essential. We present iARCS, an iterative agentic reinforcement learning framework that adapts a pretrained scene generator to natural-language task requirements. iARCS uses a two-stage strategy: universal-reward pretraining to improve physical plausibility and layout quality, followed by task-specific fine-tuning with LLM-generated reward programs that are iteratively refined from training feedback. Experiments show improved constraint fidelity on walkability, reachability, and clearance-focused tasks, effective task-specific constraint optimization, and competitive scene diversity. We further show that data generated by iARCS improves a base generator, supporting its value as a practical synthetic data generation tool rather than only a controllable scene editing method.

Explore similar work

CardsList
  1. SynCity 3000: Bootstrapping Scene-Scale 3D Diffusion

    Jul 6, 2026Paul Engstler, Iro Laina, Christian Rupprecht +13D Scenes3D Assets