cs.CVNov 10, 2026

A Lightweight Differentiable Method for Real-Time Skin Rendering and Digitization

Authors: Mario Marquez-Balduque, Carlos Rodriguez-Pardo, Jorge Lopez-Moreno

Organizations: Universidad Rey Juan Carlos, Spain · Politecnico di Milano, Milan, Italy · Euro-Mediterranean Center on Climate Change (CMCC), Lecce, Italy · RFF-CMCC European Institute on Economics and the Environment (EIEE), Milan, Italy

Abstract

Inverse rendering for skin typically relies on offline path tracing to estimate physical properties, which fail to map directly to the approximate shaders utilized in interactive applications, such as game engines. We bridge this gap by directly estimating subsurface scattering parameters tailored for real-time rendering pipelines. We introduce a differentiable Screen-Space Subsurface Scattering (SSSS) framework that enables the joint optimization of spatially varying base textures and scattering distances. To account for local variations in skin thickness, we estimate these parameters across distinct facial regions, generating a blended profile map ready for production runtime engines. Our pipeline utilizes a low-cost, single-light, single-view capture setup designed for accessible and practical appearance acquisition. Optimization is driven by a masked loss function targeting regions where subsurface scattering effects are dominant. We validate our approach on a real-world dataset of 4545 individuals across the Monk Skin Tone Scale, ensuring demographic generalization. Furthermore, we complement this evaluation with synthetic data, a multi-light setup validating our single-light assumption, and a tilted-view configuration confirming angular consistency. Results demonstrate that our method effectively recovers scattering parameters from lightweight inputs, yielding realistic skin appearance directly compatible with standard real-time shaders.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Spectral Subsurface Scattering from RGB via Biophysical Skin Inversion

    Jun 25, 2026Carlos Aliaga, Adrian JaraboInverse Rendering

  2. From Phase to Phenomenon: Self-Supervised Learning of Subsurface Scattering with Minimal Phase-shift Inputs

    Jun 28, 2026Arjun Majumdar, Raphael Braun, Andreas Engelhardt +1Inverse RenderingImage Reconstruction

  3. 3DSS: 3D Surface Splatting for Inverse Rendering

    May 7, 2026Mae Younes, Adnane BoukhaymaInverse RenderingDifferentiable Rendering