Overview

Image captioning studies how to turn images into useful descriptions, from brief scene summaries to detailed accounts of objects, attributes, relations, and changes. Common approaches combine vision encoders with Transformer or large vision-language model decoders; retrieval, region grounding, and reinforcement learning can add context or encourage more complete, faithful captions. Models are tested on datasets such as MS COCO, Flickr30k, and NoCaps, as well as specialized medical, remote-sensing, and multilingual benchmarks, using both text-overlap metrics and human or question-answering evaluations. A central challenge is balancing detail and coverage against hallucination, while evaluation remains difficult because reference captions are incomplete and automatic metrics can miss visual errors.

Latest papers

CardsList

96 papers8 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. Where Do Long Captions Fail? Position-Aware Diagnosis and Reinforcement Learning for Detailed Image Captioning

    Oct 22, 2026Yuanze Hu, Zhichao Yang, Junwei Jing +9Image CaptioningFaithfulness in VLMs

  2. Class-Grounded Batik Captioning under Scarce Text Annotation: Label Retention and Source-Specific Error Propagation

    Oct 22, 2026Novanto Yudistira, Muhammad Dzaka Aufa Fadhillah, Irawati Nurmala SariImage CaptioningImage Captioning Evaluation

  3. Making Language the Low-Rate Code of Vision: Successive Refinement from Words to Pixels

    Oct 12, 2026Ruilin Gong, Hao GongT2I GenerationImage Tokenization

  4. Metric-Driven Reinforcement Learning for Object Hallucination Reduction in LVLM-Based Image Captioning

    Oct 10, 2026Thanh Nguyen, Hee Suk Yoon, Tung Minh Luu +2Object Hallucination in VLMsVLM Hallucination Mitigation

  5. Image Bitstream Fine-grained Understanding for Privacy-Friendly AIoT

    Oct 6, 2026Zhen Yu, Wenyang Liu, Kejun Wu +3Image CaptioningPrivacy-Preserving ML

  6. PAIQ: Patch-Aligned Semantic Injection via Residual Rotation

    Sep 29, 2026Pinze Ren, Yuwei Zhang, Hao Chen +3Visual Question AnsweringImage Captioning

  7. Momentum-Coupled Rubric Adaptation for Detailed Image Captioning

    Sep 29, 2026Zhenwen Ji, Lei Jin, Shanyong Wang +6Image CaptioningRubric-Based RL

  8. Reassessing Global Gradient-Norm Imbalance in BLIP Fine-Tuning Across Physical Domains

    Sep 20, 2026Kiran Naseer, Samreen Azhar, Dwarikanath MahapatraImage CaptioningVLM Adaptation

  9. Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint

    Sep 17, 2026Zhiyun Jiang, Hanyong Wang, Binbin Liang +3Image CaptioningVision-Language Models

  10. Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge

    Sep 16, 2026Dayoung Kil, Seong-heum KimUnified Multimodal ModelsEfficient Multimodal Inference

  11. PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

    Sep 16, 2026Sara Pieri, Evangelos Kazakos, Shizhe Chen +2Image CaptioningPanoptic Segmentation

  12. RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes

    Sep 12, 2026Abhirama Subramanyam Penamakuri, Shreya Shukla, Anand MishraImage CaptioningRetrieval-Augmented Generation

  13. Human-Centric Image Captioning with Subject-Centered Spatial Understanding

    Sep 8, 2026Bozhou Li, Jiahang Zhang, Yue Ding +11VLM EvaluationImage Captioning

  14. Controllable Image Captioning with Prompt-Conditioned Scene Rewards

    Sep 1, 2026Jongyeop Hyun, Taeyoung Kim, Hyounghun KimImage CaptioningRL for VLMs

  15. ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs

    Sep 1, 2026Yuta Kato, Shintaro Ozaki, Kazuki Hayashi +4Retrieval-Augmented GenerationImage Captioning

  16. A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss

    Sep 1, 2026Suryaansh Jain, Rahasya Barkur, Vishal G +8Contrastive LearningImage Captioning

  17. An Integrated Vision-and-Language Pretraining (VLP) and Visual Question Answering (VQA) model to Automate Nondestructive Evaluation Image Analysis

    Aug 29, 2026Mehrdad Shafiei Dizaji, Hoda AzariNon-Destructive TestingImage Captioning

  18. Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance

    Aug 28, 2026Jiazhao Liang, Hao Huang, Shuaihang Yuan +8Assistive Technology for Blind and Low-Vision PeopleImage Captioning

  19. LUX: A Lesion-Aware Graph-Conditioned Visual - Language Architecture for Explainable Endoscopic Captioning

    Aug 24, 2026Alexis Ivan Escamilla-Lopez, Gilberto Ochoa-Ruiz, Salvador Hinojosa +1Image CaptioningMedical VLMs

  20. PatchGate: Narrowing the Verbalization Gap with Intrinsic Object Inventories in Frozen Vision-Language Models

    Aug 22, 2026Jihyung Ko, Eunji Jung, Hyeongsub Kim +4Image CaptioningVision-Language Models

  21. Re3^3Cap: Retrieval-Guided Refinement for Image Captioning Enhancement via Reinforcement Learning

    Aug 21, 2026Haonan Jia, Shichao Dong, Zenghui Sun +7Image CaptioningRL for VLMs

  22. Institutional Books - Visual Elements: An open-source pipeline for extracting, classifying, deduplicating, and captioning visual elements from digital book collections

    Aug 19, 2026Jimmy Mendez, Matteo Cargnelutti, David Lowry-Duda +5Historical Document ProcessingDocument Image Understanding

  23. Clinically Structured Surrogate Rewards for Post-SFT Medical Image Captioning

    Aug 19, 2026Hyun Jun Kim, Heeseung Shin, Changwon LimImage CaptioningMedical VLMs

  24. Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors

    Aug 13, 2026Lingkai Bu, Qian Gao, Jun Fan +4Image CaptioningObject Hallucination in VLMs

  25. HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioning

    Aug 12, 2026Aysha Ashraf, Shaina Ashraf, Wafaa I. M. Hussin +3Image CaptioningRemote Sensing Image Change Captioning

  26. MMArt: A Multi-Perspective Multimodal Dataset for Visual Art Understanding

    Aug 11, 2026Shuai Wang, Wangyuan Ding, Yixian Shen +5Image CaptioningVision-Language Models

  27. CAPEval: A Decoupled Caption Evaluation across Understanding and Generation

    Aug 3, 2026Zhipeng Liu, Haochen Wang, Zhaoxiang ZhangImage CaptioningImage Captioning Evaluation