cs.CVNov 16, 2026

MORE: Merge Once, Route Early for Training-Free Multi-Subject Composition from Large LoRA Pools

Authors: Tian Xia

Abstract

Public hubs offer many personalized LoRAs per text-to-image backbone, yet composing two of them in one image remains fragile. In FLUX, keeping a pool of K=10K=10 or 2020 subject LoRAs loaded makes their deltas interfere, and even loading only the two requested LoRAs keeps both subjects in fewer than 4% of images: one subject vanishes, the two fuse, or the image splits into a collage. We present MORE (Merge Once, Route Early), a training-free two-stage pipeline for FLUX. Merge once: the whole pool is folded into a single fixed-rank adapter by the subspace-regression router of SSR-Merge, made reliable by ridge, rank and calibration choices, and factored exactly into a shared part and per-subject parts. Route early: during the first 30% of the denoising steps each subject's part is gated to its layout region; a decaying soft attention bias ties every region to its own subject tokens, and a cyclic swap guidance extrapolates away from the prediction with the subjects' regions permuted, which counteracts region homogenization. On held-out seeds, MORE keeps both subjects in 94.2% (K=10K=10) and 78.3% (K=20K=20) of images, against 50.8% / 35.8% for FreeFuse and 25.0% / 24.2% for LoRAShop, and reaches an ImageReward of 1.32 (best baseline 0.07), while all KK subjects stay in one adapter. With layouts inferred automatically it still keeps both subjects in 70.0% / 55.0% of images.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. FreeFuse: Multi-Subject LoRA Fusion via Adaptive Token-Level Routing at Test Time

    Oct 27, 2025Yaoli Liu, Yao-Xiang Ding, Kun ZhouSubject-Driven Image GenerationCompositional T2I Generation

  2. Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting

    Jun 2, 2026Georgios Tsoumplekas, Stella Bounareli, Vasileios ArgyriouSubject-Driven Image GenerationCompositional T2I Generation

  3. RefCompose: Multi-Reference Image Generation via LoRA-Conditioned Diffusion

    Sep 26, 2026Sai Sri Teja Kuppa, Parth Shinde, Priyadharsan Balaji S +2Image GenerationCompositional Image Generation