cs.CVSep 26, 2026

RefCompose: Multi-Reference Image Generation via LoRA-Conditioned Diffusion

Authors: Sai Sri Teja Kuppa, Parth Shinde, Priyadharsan Balaji S, Jinka Harshavardhan, Sriprabha Ramanarayanan

Organizations: Eros Innovation, India

Abstract

Filmmakers and visual artists routinely need to compose multiple references, actors, locations, props, cultural elements, into a single coherent shot, but existing tools either fail to scale past a handful of references or destroy fine grained subject identity in the process, since per reference tokenization scales memory linearly with reference count NN and generated content often departs from the given references rather than reproducing them. We propose RefCompose, a pixel space compositional conditioning framework that decouples where things go from what they look like, via a single fixed resolution reference canvas that keeps conditioning size constant regardless of reference count. Spatial layout is induced at inference time from a frozen diffusion transformer and extracted via Grounding DINO, requiring no LLM or dedicated layout model, while dual stream LoRA adapters inject a layout derived depth map and the encoded canvas through separate low rank streams, disentangling geometric scaffolding from localized appearance. On the Dense Layout protocol, RefCompose consistently outperforms layout based and state of the art multi reference baselines on color, texture, shape, spatial accuracy, and identity/content preservation at higher reference counts, all with constant inference memory, making it a practical building block for multi subject cinematic composition at production scale.

Figures & tables

Explore similar work

CardsList
  1. Rectify Then Diffuse: Disentangling Concepts Before Denoising Trajectory Unfolds

    Aug 4, 2026Ning Zhu, An Chen, Mengfei Zhao +4T2I GenerationAttention Control in Diffusion Models

  2. ControlRef: Efficient Layout-Guided Multi-Instance Generation via Anchored 4D-RoPE

    Aug 7, 2026Yunkai Yang, Yudong Zhang, Xinying Chen +7Rotary Positional EmbeddingsDiffusion Transformer