cs.CV · 2607.14580 Copy arXiv ID · Jul 16, 2026 Save Advanced Image Generation: Negative Prompt Optimization and Latent Classifier Guidance Authors: Vaddi Charan Sai Nandan Reddy , Harini B , Chandana M S
Organizations: Department of Computer Science, PES University, Bangalore, India
Abstract We present a novel system that integrates negative prompt optimization via a fine-tuned sequence-to-sequence LLM and latent-space classifier guidance to improve the quality of images generated by Stable Diffusion. Our approach automatically generates optimized negative prompts, and employs a CNN-RNN hybrid classifier to evaluate and guide diffusion steps, rolling back low-quality latent updates. Experimental results demonstrate that our dual-guidance framework reduces artifacts and improves semantic fidelity compared to baseline diffusion.
Explore similar work May 5, 2026 · Sucheng Ren, Chen Chen, Zhenbang Wang +5 Text-To-Image Visual Generation
Jun 29, 2026 · Yoonseok Choi, Chaeyoung Oh, Hyunjun Choi +2 Text-To-Image Diffusion Models
Feb 6, 2025 · cs.CV J/K move · Enter open · S save
Zhenyu Zhou, Defang Chen, Can Wang, Chun Chen +1
Zhejiang University, State Key Laboratory of Blockchain and Data Security · University at Buffalo, State University of New York
Text-to-image diffusion models are capable of generating high-quality images, but suboptimal pre-trained text representations often result in these images failing to align closely with the given text prompts. Classifier-free guidance (CFG) is a popular and effective technique for improving text-image alignment in the generative process. However, CFG introduces significant computational overhead. In this paper, we present DIstilling CFG by sharpening text Embeddings (DICE) that replaces CFG in the sampling process with half the computational complexity while maintaining similar generation quality. DICE distills a CFG-based text-to-image diffusion model into a CFG-free version by refining text embeddings to replicate CFG-based directions. In this way, we avoid the computational drawbacks of CFG, enabling high-quality, well-aligned image generation at a fast sampling speed. Furthermore, examining the enhancement pattern, we identify the underlying mechanism of DICE that sharpens specific components of text embeddings to preserve semantic information while enhancing fine-grained details. Extensive experiments on multiple Stable Diffusion v1.5 variants, SDXL, and PixArt-
α α α demonstrate the effectiveness of our method. Code is available at https://github.com/zju-pi/dice.