Geometric Guidance

Geometric guidance is a rapidly developing field focusing on improving the accuracy and efficiency of various computer vision and graphics tasks by incorporating geometric information into model training and inference. Current research emphasizes leveraging geometric cues, such as depth maps, surface normals, and segmentation masks, within diverse architectures including diffusion models, neural radiance fields, and transformers, to enhance tasks like image generation, 3D reconstruction, and motion animation. This approach leads to significant improvements in the quality and realism of generated outputs, impacting applications ranging from augmented reality and robotics to CAD modeling and medical imaging.

Papers