cs.CVSep 4, 2026

An Evaluation Framework for Generating Multi-View Images of a Person in a Scene

Authors: Mahir Majid, Young Kyung Kim, Guillermo Sapiro

Organizations: Princeton University

Abstract

Recent generative image-editing Diffusion Transformers (DiTs) demonstrate impressive semantic editing capabilities but still struggle with spatially consistent camera angle changes. A primary bottleneck in training foundation models to execute free-form, promptable camera angle changes is the lack of specialized training data. While multi-view datasets exist for generic 3D environments and objects, there remains an absence of paired, multi-view datasets featuring human subjects at fixed locations in natural scenes, including frontal and side-profile views. Capturing such multi-camera data in unconstrained environments is logistically challenging and unscalable. In this paper, we first experiment with multiple state-of-the-art image editing models to create this data synthetically, but find that the outputs are frequently prone to hallucinations involving how much the subject's head turns relative to the background, often producing inconsistent environments. To address this issue, we propose the Head Scene Rotation Difference (HSRD) metric to quantitatively evaluate camera movements around a person. The proposed metric operates by decoupling camera movement from localized head pose manipulation. As demonstrated by the extensive experimentation, HSRD provides the pipeline necessary to evaluate 3D spatial parallax for a person in a scene, paving the way to reliably construct high-quality multi-view synthetic datasets.

Figures & tables

Explore similar work

CardsList
  1. HumanOrbit: 3D Human Reconstruction as 360° Orbit Generation

    Feb 27, 2026Keito Suzuki, Kunyao Chen, Lei Wang +5Multi-View Image Synthesis3D Human Reconstruction

  2. StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts

    Sep 9, 2026Qi Zhang, Yanyifan Wang, Weiyuan Zhang +1Multi-View ConsistencyMulti-View Diffusion Models

  3. Photorealistic Novel View Synthesis of Human Faces using Next-Scale Transformers

    Aug 24, 2026Federico Stella, Fei Jiang, Zhongshi Jiang +4Novel View SynthesisMulti-View Image Synthesis