Text-Image Alignment

Follow this topic Ask about this topic

Momentum

1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 17

All topics

Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models
Sep 14, 2026Alessandro Gambetti, Qiwei HanText-Image Alignment Vision-Language Retrieval
NOVA School of Science and Technology · Universidade NOVA de Lisboa · Caparica, Portugal +2
PanDent: Toward Comprehensive Tooth-Level Structure-Language Consistency in Dental Radiology
Jul 29, 2026Xiaohan Li, Xinyu Liu, Chang Liu +4Radiology Report Generation Medical Imaging
Faculty of Dentistry, The University of Hong Kong, Hong Kong, China · Department of Computing, Imperial College London, London, United Kingdom · University of Science and Technology of China, Hefei, China +2
Anchoring and Steering Diffusion: Enhancing the Faithfulness of Text-to-Image Generation at Inference Time
Jul 29, 2026Xinyi Wang, Yuyang Huang, Yalin Su +4Diffusion Model Guidance Text-Image Alignment
Shanghai Jiao Tong University, Shanghai, China
Reinforcing the Generation Order of Multimodal Masked Diffusion Models
Jul 9, 2026Yidong Ouyang, Zhe Wang, Sourav Bhabesh +1Text-Image Alignment RL for Diffusion Models
University of California, Los Angeles · AGI Foundations for AWS
Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignment
Jun 29, 2026Soyoun Won, Aryan Yazdan Parast, Basim Azam +2Text-Image Alignment T2I Generation
The University of Melbourne, Australia
GAVEL: Grounded Caption Error Verification and Localization
Jun 25, 2026Zixian Gao, Atsushi Hashimoto, Kuniaki SaitoVLM Evaluation Text-Image Alignment
OMRON SINIC X Corporation
STEDiff: Strengthening Text Embedding for Text-to-Image Alignment in Diffusion Model
Jun 9, 2026Hailan Zhang, Haipeng Liu, Bo Fu +1Text Embeddings Text-Image Alignment
School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, China · School of Computer and Artificial Intelligence, Liaoning Normal University, Dalian, China
Variational Adapter for Cross-modal Similarity Representation
May 29, 2026WenZhang Wei, Zhipeng Gui, Dehua Peng +2Cross-Modal Representation Learning VLM Adaptation
School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · School of Data Science and Engineering, East China Normal University, Shanghai 200062, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China
Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models
May 28, 2026Jaa-Yeon Lee, Yeobin Hong, Taesung Kwon +1Diffusion Model Alignment Text-Image Alignment
Graduate School of AI, KAIST, South Korea.
FAST-GOAL: Fast and Efficient Global-local Object Alignment Learning
May 26, 2026Hyungyu Choi, Young Kyun Jang, Chanho EomVLM Adaptation Text-Image Alignment
Department of Virtual Convergence, Graduate School of Advanced Imaging Science, Multimedia & Films (GSAIM), Chung-Ang University, Seoul, South Korea
Do Image-Text Metrics Respect Semantic Invariances?
May 23, 2026Amit Agarwal, Hitesh Laxmichand Patel, Meizhu Liu +9VLM Evaluation Multimodal Robustness
Oracle AI
Offline Preference Optimization for Rectified Flow with Noise-Tracked Pairs
May 10, 2026Yunhong Lu, Qichao Wang, Hengyuan Cao +2Pairwise Preference Learning Rectified Flow
Zhejiang University · Shanghai Institute for Advanced Study-Zhejiang University · Shanghai Institute for Mathematics and Interdisciplinary Sciences
HNC: Leveraging Hard Negative Captions towards Models with Fine-Grained Visual-Linguistic Comprehension Capabilities
May 6, 2026Esra Dönmez, Pascal Tilli, Hsiu-Yu Yang +2Cross-Modal Learning Image Matching
Institute for Natural Language Processing, University of Stuttgart
Probing CLIP's Comprehension of 360-Degree Textual and Visual Semantics
Apr 27, 2026Hai Wang, Xiaochen Yang, Mingzhi Dong +1VLM Evaluation VLM Adaptation
Department of Statistical Science, University College London, UK · School of Mathematics and Statistics, University of Glasgow, UK · Department of Computer Science, University of Bath, UK.
Oracle Noise: Faster Semantic Spherical Alignment for Interpretable Latent Optimization
Apr 26, 2026Haosen Li, Wenshuo Chen, Lei Wang +3Diffusion Model Alignment Text-Image Alignment
1The Hong Kong University of Science and Technology (Guangzhou) · 2Griffith University & Data61/CSIRO
Test-time Prompt Refinement for Text-to-Image Models
Jul 22, 2025Mohammad Abdul Hafeez Khan, Yash Jain, Siddhartha Bhattacharyya +1Text-Image Alignment T2I Generation
Florida Institute of Technology, USA · Microsoft Research, USA
ELBO-T2IAlign: A Generic ELBO-Based Method for Calibrating Pixel-level Text-Image Alignment in Diffusion Models
Jun 11, 2025Qin Zhou, Zhiyang Zhang, Jinglong Wang +5Diffusion Model Alignment Text-Image Alignment
School of Software, Beihang University, Beijing 100191, China · College of Computer and Cyber Security, Hebei Normal University, Hebei 050024, China · Department of Computer Science, The University of Hong Kong, Hong Kong

Sep 14, 2026, cs.CVJ/K move · Enter open · S save

Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models

Alessandro Gambetti, Qiwei Han

NOVA School of Science and Technology · Universidade NOVA de Lisboa · Caparica, Portugal+2

Text-Image Alignment Vision-Language Retrieval VLM Calibration

Open paper AskPDF arXiv

Long-text image--text congruence scoring is increasingly important for vision-language systems that must evaluate whether detailed textual descriptions match visual content. However, raw similarity scores from dual-encoder models are difficult to interpret as calibrated congruence measures, especially under the modality gap between image and text embeddings. This paper proposes Congruency Score (CS), a lightweight calibration layer that maps image--text similarity evidence into a bounded score. Using DOCCI and Urban1k, we evaluate four frozen vision-language backbones and show that observed reductions in post-projection centroid distance do not uniformly improve image--text retrieval performance. Human-grounded evaluations on DOCCI further reveal a trade-off: direct post-hoc calibration preserves high association with human judgments, whereas selected projection-based configurations can reduce threshold-relevant slope and intercept distortions at the cost of retrieval performance and association strength. These results establish long-text image--text congruence scoring as a calibrated score-estimation problem, where retrieval performance, human association, and threshold calibration must be evaluated as distinct objectives. CS provides a lightweight way to expose and operationalize this separation.

Momentum

Related topics

Latest papers 17