DimFlow: Bidirectional Grid-Expert Learning for Dynamic Gaussian Reconstruction
Organizations: Gabriel Adineera and Jinoh Kim are with Texas A&M University-Commerce, USA.
Abstract
Dynamic Gaussian reconstruction requires compact scene features to support coordinated changes in geometry and appearance. A factorized grid provides efficient local queries, but accurate interpolation alone does not ensure that the resulting dynamic attributes remain compatible across space and time. We introduce DimFlow, a framework that learns these features through bidirectional interaction between a multi-resolution grid and a coordinate-based expert branch. Feature-level adversarial alignment connects their distributions, adaptive fusion transfers complementary information, and activation-masked residual feedback refines the grid during training. Four attribute experts organize deformation, rotation, opacity, and temporal information before Gaussian rendering. In the aggregate comparison across D-NeRF, HyperNeRF, and DAVIS, DimFlow achieves 39.73 dB PSNR, improving on 4D-GS by 1.92 dB while matching its reported 85 FPS rendering speed. The model occupies 18.9 MB, compared with 18.3 MB for 4D-GS. Component and attribute-expert ablations reveal complementary contributions from feature alignment, adaptive exchange, and temporal processing.
Figures & tables
| Method | PSNR | SSIM | LPIPS | Train | FPS | Storage |
|---|---|---|---|---|---|---|
| dB | min s | MB | ||||
| K-Planes [ 6 ] | ||||||
| TiNeuVox-B [ 4 ] | ||||||
| HexPlane [ 5 ] | ||||||
| 4D-GS [ 9 ] | ||||||
| MSTH [ 7 ] | – | – |
| Variant | PSNR | SSIM | LPIPS | |
|---|---|---|---|---|
| Full model | 0.00 | |||
| w/o adversarial alignment | 1.88 | |||
| w/o adaptive weighting | 1.61 | |||
| w/o temporal feature flow | 1.79 | |||
| w/o bidirectional exchange | 1.71 | |||
| w/o coordinate expert | 2.03 |
| Metric | Full model | No deformation | No temporal |
|---|---|---|---|
| PSNR | 38.79 | 36.53 | 37.12 |
| SSIM | 0.98 | 0.95 | 0.96 |
| LPIPS | 0.03 | 0.05 | 0.04 |
| FlowsME | 0.12 | 0.31 | 0.58 |
| TSV | 0.015 | 0.028 | 0.030 |
| EDE | 0.08 | 0.21 | 0.16 |
Dynamic Scene Reconstruction
Dynamic scene reconstruction builds time-varying 3D models of moving objects and environments from video or multi-view images.
See all 288 papers