Neural Texture
Neural textures represent a powerful approach to modeling and manipulating textures in images and 3D models, aiming to improve realism and control in computer graphics and related fields. Current research focuses on developing neural network architectures, such as diffusion models and U-Nets, to generate, edit, and render high-fidelity textures from various inputs, including text descriptions and multi-view images, often incorporating Gaussian splatting or other efficient rendering techniques. This work has significant implications for applications ranging from avatar creation and animation to medical image analysis and robotic manipulation, enabling more realistic and controllable simulations and visualizations. The development of robust and efficient neural texture methods is driving advancements in several scientific and engineering domains.
Papers
Dynamic Neural Textures: Generating Talking-Face Videos with Continuously Controllable Expressions
Zipeng Ye, Zhiyao Sun, Yu-Hui Wen, Yanan Sun, Tian Lv, Ran Yi, Yong-Jin Liu
Neural Texture Extraction and Distribution for Controllable Person Image Synthesis
Yurui Ren, Xiaoqing Fan, Ge Li, Shan Liu, Thomas H. Li