Overview

Image captioning studies how to turn images into useful descriptions, from brief scene summaries to detailed accounts of objects, attributes, relations, and changes. Common approaches combine vision encoders with Transformer or large vision-language model decoders; retrieval, region grounding, and reinforcement learning can add context or encourage more complete, faithful captions. Models are tested on datasets such as MS COCO, Flickr30k, and NoCaps, as well as specialized medical, remote-sensing, and multilingual benchmarks, using both text-overlap metrics and human or question-answering evaluations. A central challenge is balancing detail and coverage against hallucination, while evaluation remains difficult because reference captions are incomplete and automatic metrics can miss visual errors.

Latest papers

CardsList

96 papers8 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. Asymmetric Idiosyncrasies in Multimodal Models

    Feb 26, 2026Muzi Tao, Chufan Shi, Huijuan Wang +2T2I GenerationT2I Generation Evaluation

  2. CCCaption: Dual-Reward Reinforcement Learning for Complete and Correct Image Captioning

    Feb 25, 2026Zhijiang Tang, Linhua Wang, Jiaxin Qi +4Image CaptioningRL for VLMs

  3. How Do Inpainting Artifacts Propagate to Language?

    Feb 24, 2026Pratham Yashwante, Davit Abrahamyan, Shresth Grover +1VLM RobustnessVLM Evaluation

  4. Parameter Efficient Multimodal Instruction Tuning for Romanian Vision Language Models

    Dec 16, 2025George-Andrei Dima, Răzvan-Alexandru Smădu, Dumitru-Clementin CercelVLM AdaptationImage Captioning

  5. Align Where the Words Look: Cross-Attention-Guided Patch Alignment with Contrastive and Transport Regularization for Bengali Captioning

    Sep 22, 2025Riad Ahmed Anonto, Sardar Md. Saffat Zabin, M. Saifur RahmanImage CaptioningVLM Adaptation

  6. Redemption Score: A Multi-Modal Evaluation Framework for Image Captioning via Distributional, Perceptual, and Linguistic Signal Triangulation

    May 22, 2025Ashim Dahal, Ankit Ghimire, Saydul Akbar Murad +1Image CaptioningImage Captioning Evaluation