ObjectMorpher: 3D-Aware Image Editing via Deformable 3DGS Models
Organizations: The University of Hong Kong
Abstract
Achieving precise, object-level control in image editing remains challenging: 2D methods lack 3D awareness and often yield ambiguous or implausible results, while existing 3D-aware approaches rely on heavy optimization or incomplete monocular reconstructions. We present ObjectMorpher, a unified, interactive framework that converts ambiguous 2D edits into geometry-grounded operations. ObjectMorpher lifts target instances with an image-to-3D generator into editable 3D Gaussian Splatting (3DGS), enabling fast, identity-preserving manipulation. Users drag control points; a graph-based non-rigid deformation with as-rigid-as-possible (ARAP) constraints ensures physically sensible shape and pose changes. A composite diffusion module harmonizes lighting, color, and boundaries for seamless reintegration. Across diverse categories, ObjectMorpher delivers fine-grained, photorealistic edits with superior controllability and efficiency, outperforming 2D drag and 3D-aware baselines on KID, LPIPS, SIFID, and user preference.
Figures & tables
| Methods | LPIPS | SIFID | KID | RI | MT |
|---|---|---|---|---|---|
| DragGAN | 0.550 | 16.091 | -0.056 | ✓ | 10s |
| ImageSculpting | 0.178 | 14.372 | -0.055 | ✓ | 30m |
| DragDffusion ∗ | 0.117 | 6.573 | -0.075 | 2m | |
| DragAnything | 0.655 | 22.476 | -0.047 | 70s | |
| Anydoor | 0.173 | 9.512 | -0.049 | 10s | |
| InstantDrag | 0.218 | 13.744 | -0.042 | 10s |
3D Shape Editing
3D shape editing changes the geometry, appearance, or parts of digital objects using spatial controls, prompts, images, or generative models.
See all 53 papers