cs.MMNov 6, 2026

UniMore: Fine-Grained Supervision for Unified Understanding and Generation

Authors: Haoyue Bai, Yinyi Luo, Yicheng He, Qingsong Wen, Sharon Li, Jindong Wang

Organizations: William & Mary · Carnegie Mellon University · University of Illinois Urbana-Champaign · Squirrel Ai Learning · 

Abstract

Unified multimodal models combine image understanding and generation within one system, creating an opportunity to improve both capabilities through paired image--text supervision. We examine the outputs of a pretrained unified model in both directions and observe a loss of specificity: generated images can contain the requested objects with incorrect attributes, while captions identify a scene without expressing its distinguishing details. These failures call for supervision that specifies both the visual content to realize and the descriptive differences to distinguish. We propose UniMore, a post-training method that derives these complementary learning tasks from the fine-grained content of image--text pairs. The generation route predicts grounded crops from their corresponding phrases, matching the scope of the condition and visual target while using the native visual objective. The understanding route combines positive-caption fitting with ranking against captions that omit or alter details, conditioned on the full image. The two routes are optimized independently, and their learned updates are combined into a single unified model without changing its inference procedure. Experiments show gains across multiple understanding and generation benchmarks.

Figures & tables

Explore similar work

CardsList
  1. Steering Visual Generation in Unified Multimodal Models with Understanding Supervision

    May 7, 2026Zeyu Liu, Zanlin Ni, Yang Yue +5Unified Multimodal ModelsImage Generation

  2. Learning to Generate via Understanding: Understanding-Driven Intrinsic Rewarding for Unified Multimodal Models

    Mar 6, 2026Jiadong Pan, Liang Li, Yuxin Peng +6Unified Multimodal ModelsT2I Generation

  3. Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System

    Sep 1, 2026Penghao Wu, Haiwen Diao, Weichen Fan +3Unified Multimodal ModelsMultimodal Generation