ChromaGS: Text-Driven Semantic Editing of 4D Gaussian Avatars
Organizations: Universitat Polit`ecnica de Catalunya · Institut de Rob`otica i Inform`atica Industrial, CSIC-UPC
Abstract
We present ChromaGS, a method for real-time, language-guided color editing of animatable 3D Gaussian head avatars. Given a trained animatable avatar, users can instantly modify the color of semantic regions through natural language, with edits applied at render time and no retraining required. Our key insight is to augment each Gaussian primitive with learned soft assignments to semantic regions and decompose colors into region-level base colors and Gaussian-level residuals. This decomposition enables coherent color transfer: modifying a region's base color propagates naturally through all associated Gaussians while preserving fine appearance details encoded in residuals. A two-stage language pipeline translates text instructions into target colors, supporting both absolute specifications and relative adjustments. Unlike generative editing methods that may introduce unintended modifications, our approach provides deterministic, precisely localized semantic control. Experiments demonstrate faithful appearance preservation and intuitive interaction across diverse subjects. Project page and code are available at: https://a-canela.github.io/chromags/
Figures & tables
| Method | Train | Edit | Render |
|---|---|---|---|
| IPix2Pix [ 22 ] | N/A | 400 ms | N/A |
| GAEditor [ 5 ] | ← 800 s → | 100 fps | |
| ChromaGS (Ours) | 800 s | 50 ms | 100 fps |
| Method | CLIP | Identity | Context |
|---|---|---|---|
| IPix2Pix [ 22 ] | 0.231 | 0.691 | 0.790 |
| GAEditor [ 5 ] | 0.229 | 0.863 | 0.790 |
| ChromaGS (Ours) | 0.212 | 0.986 | 0.980 |
| Method | CLIP | Identity | Context |
|---|---|---|---|
| Ours w/o | 0.198 | 0.969 | 0.967 |
| Ours | 0.213 | 0.990 | 0.986 |
3D Scene Editing
3D scene editing studies how to make controlled changes to objects, appearance, layout, and motion while keeping a scene coherent across views.
See all 88 papers