We present FlowFixer, a refinement framework for subject-driven generation (SDG) that restores fine details lost during generation caused by changes in scale and perspective of a subject. FlowFixer proposes direct image-to-image translation from visual references, avoiding ambiguities in language prompts. To enable image-to-image training, we introduce a one-step denoising scheme to generate self-supervised training data, which automatically removes high-frequency details while preserving global structure, effectively simulating real-world SDG errors. We further propose a keypoint matching-based metric to properly assess fidelity in details beyond semantic similarities usually measured by CLIP or DINO. Experimental results demonstrate that FlowFixer outperforms state-of-the-art SDG methods in both qualitative and quantitative evaluations, setting a new benchmark for high-fidelity subject-driven generation.
Figures & tables
Figure 2: FlowFixer overview. FlowFixer enhances SDG images by restoring fine subject details, using the original subject image as reference.
Figure 3: FlowFixer inference pipeline. The model takes two conditional inputs: reference subject image Iref and the generated image Igen from any SDG model. Then the model produces a refined result Igen that preserves global layout. For faster inference, we optionally refine only a subject-centric crop of Igen and blend it back using Poisson image blending.
Figure 4: Example of one-step denoising distortions. For each distortion level, pixel-wise variance maps are computed over 10 degraded samples. Insets show example outputs, with distortions concentrated in high-frequency regions.
Method
FLUX.1-Kontext-Pro
Qwen-Image-Edit
Nano-Banana-Edit
AKI ↑
KGain↑
CLIP-I ↑
DINO ↑
AKI ↑
KGain↑
CLIP-I ↑
DINO ↑
AKI ↑
KGain↑
CLIP-I ↑
DINO ↑
Baseline
-
-
0.776
0.663
-
-
0.777
0.668
-
-
0.796
0.711
Text-based editing [ 19 ]
7.5
52.7%
0.763
0.647
11.1
54.1%
0.762
0.647
61.7
77.0%
0.782
0.691
OminiControl [ 39 ] + F-Dev
29.0
53.9%
0.724
0.551
0.48
43.8%
0.724
0.552
108.0
70.7%
0.747
0.605
OminiControl [ 39 ] + F-Kontext
0.49
45.7%
0.766
0.649
-3.37
46.8%
0.765
0.649
53.0
56.6%
0.786
0.696
FlowFixer (ours)
66.5
77.9%
0.778
0.668
54.0
74.8%
0.777
0.668
64.7
79.2%
0.796
0.711
Table 1: Refinement performance on the FidelityBench-258K. For all metrics, higher numbers indicate better performance.
Figure 5: Qualitative comparison on Subject fidelity refinement on the FidelityBench-258K dataset. The insets in the full images show the reference subject images and the red and green boxes indicate the zoomed-in regions. The regions for zoomed-in views are found on the SDG baseline images and cropped the same area for all methods.
Method
AKI ↑
KGain↑
VLM ↑
Text-based editing [ 19 ]
1.87
45.9%
41.3%
OminiControl [ 39 ] + F-Dev
22.7
46.6%
4.2%
OminiControl [ 39 ] + F-Kontext
11.1
38.4%
25.2%
FlowFixer (ours)
67.3
91.2%
79.0%
Table 2: Refinement performance compared to original SDG images on the FidelityBench-300. For all metrics, higher numbers indicate better performance.
Figure 6: Scatter plots of the number of keypoint matches on FidelityBench-300. Each dot represents a sample; points above the red dashed line indicate an increase in keypoint matches (positive AKI, green region), suggesting improved structural alignment and subject fidelity. Samples below the line show decreased correspondence after refinement.
Figure 7: A/B study results comparing the FlowFixer against four alternatives. FlowFixer is consistently preferred by human raters.
Figure 8: Impact of training distortion levels on refinement performance. Using a range of distortion levels during training enhances the model’s ability to handle diverse degradation at inference time, resulting in more robust restoration.
Figure 9: Efficacy of cropped refinement in comparison with full image refinement. While full image refinement moderately enhances subject fidelity, cropping further improves legibility.
Subject-driven text-to-image generation still struggles to preserve high-frequency identity details such as logos, patterns, and text. Existing methods typically operate directly in RGB space, which often leads to detail degradation under substantial edits. We propose a two-stage framework that decouples structure from appearance by first predicting a Canny map and then rendering the final image conditioned on both the source appearance and the predicted structure. To improve text handling, we further introduce a fully automatic pipeline that constructs a 100k-pair text-aware dataset with cross-view textual consistency. Experiments, including GPT-4.1-based evaluation and a knowledge distillation study, show clear gains over selected baselines and suggest that intermediate structural prediction is an effective route for high-fidelity subject-driven generation. Our dataset and code will be made publicly available.
Hanzhong Guo, Yizhou Yu
School of Computing and Data Science, The University of Hong Kong
Recent subject-to-image models have achieved impressive progress in personalized image generation, yet they still struggle to preserve fine-grained subject-specific details. A major reason is the lack of high-quality fine-grained identity supervision: real paired data are expensive to collect, while synthesized training pairs often preserve only coarse subject appearance and fail to capture subtle subject-specific details. In this work, we propose CopyCat, a lightweight model-refinement framework that improves fine-grained subject consistency within only a few seconds. CopyCat performs a one-time refinement of a pretrained subject-to-image model by attaching a lightweight Fine-grained Consistency LoRA (FCLoRA) and optimizing it using a single proxy image, which is used as both the conditioning image and the reconstruction target. This exact self-reconstruction objective substantially simplifies the optimization task, enabling effective fine-grained refinement within only a few seconds. The refinement is performed only once; the resulting model can be directly applied to diverse unseen reference subjects and prompts without further subject-specific optimization. We further revisit subject-to-image LoRA training in double-stream diffusion transformers and find that adapting only the visual stream consistently improves subject consistency. Extensive experiments on DreamBench and XVerseBench demonstrate consistent improvements in fine-grained subject consistency across representative subject-to-image models under both single- and multi-subject settings.
Peng Zheng, Ruiqi Liu, Rui Ma +1
School of Artificial Intelligence, Jilin University · 2Shanghai Innovation Institute · 4Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China +1
Flow-based image generators achieve strong semantic synthesis but still produce localized structural distortions, such as malformed hands and limbs. Existing post-training methods typically optimize global scalar rewards, which provide weak spatial credit assignment and may alter well-formed regions while correcting local defects. We present Diagnose-to-Generate (D2G), a grounded alignment framework that separates visual diagnosis from generative optimization. We construct Achilles-600K, a region-annotated dataset for structural anomalies, and train ARGUS through supervised cold-start and Region-Aware Group Relative Policy Optimization to predict anomaly categories and bounding boxes. These diagnoses are converted into confidence-weighted spatial rewards for our Patch-level Flow-GRPO. We further identify that global stochastic exploration can shift semantic regions across group rollouts, making patch-wise relative advantages spatially inconsistent. Our Trajectory-Preserving Stochastic Sampling (TPSS) anchors early denoising with deterministic ODE trajectories and introduces stochasticity only at later steps, thereby limiting intra-group spatial drift while retaining local exploration. Experiments on FLUX.1-dev and SD3.5 show improved structural fidelity with preserved FID and CLIP scores. Consistent gains under HumanRefiner, zero-shot GPT-4.1, and blinded human evaluation further demonstrate that the improvements extend beyond the training reward model.
Yifan Li, Lishuai Gao, Tong Zhang +8
University of Science and Technology of China, Hefei, AnHui Province, China · Meituan Inc., Beijing, China