PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Poster
Organizations: Wuhan University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · The Hong Kong University of Science and Technology (Guangzhou)
Abstract
Automated e-commerce poster design requires both high-quality poster generation and flexible editing of existing designs. However, most existing methods either target end-to-end poster generation or follow multi-stage design pipelines, with limited capability for flexible and precise editing of existing posters. To enable unified generation and editing of e-commerce posters, we introduce Text Patch Generation and Editing, a unified task formulation that treats text patches as atomic units and covers four operations: poster generation, patch addition, patch deletion, and patch modification, with optional reference-guided style control. Based on this, we propose PosterText, a unified model trained with a four-stage curriculum, including text rendering pretraining, instruction-following training, reinforcement learning for preference alignment, and spatial guidance self-distillation for execution refinement. We further construct a large-scale dataset with patch-level annotations and a comprehensive benchmark for evaluation. Extensive experiments demonstrate that PosterText achieves competitive performance against existing generation and editing approaches, validating the effectiveness of the proposed framework.
Figures & tables
| Patch Addition | Patch Deletion | Patch Modification | Poster Generation | |||||||||||||
| Method | S.A. | NED | M-L. | I.F. | V.Q. | M-L. | I.F. | V.Q. | S.A. | NED | M-L. | I.F. | V.Q. | I.F. | V.Q. | B.P. |
| Closed-Source Methods | ||||||||||||||||
| Seedream 5.0 | 0.403 | 0.585 | 0.195 | 4.40 | 4.64 | 0.122 | 4.68 | 4.69 | 0.735 | 0.884 | 0.102 | 4.33 | 4.65 | 4.10 | 4.50 | 4.80 |
| Nano Banana 2 | 0.500 | 0.635 | 0.064 | 4.46 | 4.67 | 0.051 | 4.62 | 4.84 | 0.819 | 0.907 | 0.034 | 4.47 | 4.80 | 4.63 | 4.76 | 4.86 |
| Nano Banana Pro | 0.543 | 0.679 | 0.184 | 4.55 | 4.75 | 0.061 | 4.66 | 4.91 | 0.815 | 0.891 | 0.102 | 4.36 | 4.64 | 4.58 | 4.88 | 4.92 |
| Open-Source Methods | ||||||||||||||||
| Model | S.A. | NED | M-L. | I.F. | V.Q. |
|---|---|---|---|---|---|
| Base Model | 0.490 | 0.666 | 0.417 | 3.27 | 3.37 |
| +SFT Stage | |||||
| Stage II-only | 0.679 | 0.786 | 0.088 | 3.63 | 3.81 |
| Stage I(no cur.)+II | 0.702 | 0.831 | 0.061 | 4.00 | 4.12 |
| Stage I + II | 0.712 | 0.866 | 0.053 | 4.03 | 4.24 |
| +SFT+RL | 0.735 | 0.883 | 0.037 | 4.22 | 4.51 |
T2I Generation
Text-to-image generation creates images from natural-language prompts using generative models, with research focused on fidelity, control, efficiency, and safety.
See all 291 papers