Overview

Image captioning studies how to turn images into useful descriptions, from brief scene summaries to detailed accounts of objects, attributes, relations, and changes. Common approaches combine vision encoders with Transformer or large vision-language model decoders; retrieval, region grounding, and reinforcement learning can add context or encourage more complete, faithful captions. Models are tested on datasets such as MS COCO, Flickr30k, and NoCaps, as well as specialized medical, remote-sensing, and multilingual benchmarks, using both text-overlap metrics and human or question-answering evaluations. A central challenge is balancing detail and coverage against hallucination, while evaluation remains difficult because reference captions are incomplete and automatic metrics can miss visual errors.

Latest papers

CardsList

96 papers8 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. Weather-Robust Scene Semantics with Vision-Aligned 4D Radar

    May 8, 2026Kali Hamilton, Christoffer HeckmanCross-Modal LearningVLM Robustness

  2. DiffCap-Bench: A Comprehensive, Challenging, Robust Benchmark for Image Difference Captioning

    May 6, 2026Yuancheng Wei, Haojie Zhang, Linli Yao +7Image CaptioningMultimodal Model Evaluation

  3. Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioning

    May 4, 2026Lucrezia Tosato, Gianluca Lombardi, Ronny HanschRemote Sensing Image UnderstandingRemote Sensing Image Captioning

  4. Linguistically Informed Multimodal Fusion for Vietnamese Scene-Text Image Captioning: Dataset, Graph Framework, and Phonological Attention

    Apr 30, 2026Nhi Ngoc-Yen Nguyen, Anh-Duc Nguyen, Nghia Hieu Nguyen +2Image CaptioningLow-Resource Language Processing

  5. CANVAS: Captioning Art with Narrative Visual-Audio AI Systems

    Apr 30, 2026Vignesh NagarajanImage Captioning

  6. Retrieval-Guided Generation for Safer Histopathology Image Captioning

    Apr 27, 2026Md. Enamul Hoq, Wataru Uegami, Saghir Alfasly +6Multimodal RAGComputational Pathology

  7. JSSFF: A Joint Structural-Semantic Fusion Framework for Remote Sensing Image Captioning

    Apr 27, 2026Swadhin Das, Vivek YadavRemote Sensing Image UnderstandingRemote Sensing Image Captioning

  8. Culture-Aware Humorous Captioning: Multimodal Humor Generation across Cultural Contexts

    Apr 20, 2026Run Xu, Lu Li, Rongzhao Zhang +1Image CaptioningMultimodal Generation

  9. ReflectCAP: Detailed Image Captioning with Reflective Memory

    Apr 14, 2026Kyungmin Min, Minbeom Kim, Kang-il Lee +2Image CaptioningVLM Hallucination Mitigation

  10. EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis

    Apr 9, 2026Xiangyuan Wang, Honghao Cai, Yunhao Bai +9Direct Preference OptimizationImage Captioning

  11. DetailVerifyBench: A Benchmark for Dense Hallucination Localization in Long Image Captions

    Apr 7, 2026Xinran Wang, Yuxuan Zhang, Xiao Zhang +7VLM HallucinationVLM Evaluation

  12. ITIScore: An Image-to-Text-to-Image Rating Framework for the Image Captioning Ability of MLLMs

    Apr 4, 2026Zitong Xu, Huiyu Duan, Shengyao Qin +6Image Captioning EvaluationImage Captioning

  13. Captioning Daily Activity Images in Early Childhood Education: Benchmark and Algorithm

    Apr 2, 2026Sixing Li, Zhibin Gu, Ziqi Zhang +4Image Captioning EvaluationImage Captioning

  14. ProCap: Projection-Aware Captioning for Spatial Augmented Reality

    Apr 1, 2026Zimo Cao, Yuchen Deng, Haibin Ling +1Augmented RealityImage Captioning

  15. LLaVA-LE: Large Language-and-Vision Assistant for Lunar Exploration

    Mar 25, 2026Gokce Inal, Pouyan Navard, Alper YilmazVision-Language ModelsLarge Vision-Language Models

  16. Memory-Augmented Vision-Language Agents for Persistent and Semantically Consistent Object Captioning

    Mar 25, 2026Tommaso Galliena, Stefano Rosa, Tommaso Apicella +3Memory-Augmented VLMsVLMs for Robotics

  17. Caption Generation for Dongba Paintings via Prompt Learning and Semantic Fusion

    Mar 24, 2026Shuangwu Qian, Xiaochan Yuan, Pengfei LiuImage CaptioningCultural Heritage

  18. CycleCap: Improving VLMs Captioning Performance via Self-Supervised Cycle Consistency Fine-Tuning

    Mar 18, 2026Marios Krestenitis, Christos Tzelepis, Konstantinos Ioannidis +5Cycle ConsistencyImage Captioning

  19. HalDec-Bench: Benchmarking Hallucination Detector in Image Captioning

    Mar 16, 2026Kuniaki Saito, Risa Shinoda, Shohei Tanaka +3Image Captioning EvaluationHallucination Detection in VLMs

  20. MUNIChus: Multilingual News Image Captioning Benchmark

    Mar 11, 2026Yuji Chen, Alistair Plum, Hansi Hettiarachchi +4Image CaptioningMultilingual VLM Evaluation

  21. Grounding Synthetic Data Generation With Vision and Language Models

    Mar 10, 2026Ümit Mert Çağlar, Alptekin TemizelSynthetic Data AugmentationSynthetic Data Evaluation

  22. RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioning

    Mar 10, 2026Tzu-Heng Huang, Sirajul Salekin, Javier Movellan +2Image CaptioningRL for VLMs

  23. Prompt-Based Caption Generation for Single-Tooth Dental Images Using Vision-Language Models

    Mar 8, 2026Anastasiia Sukhanova, Aiden Taylor, Julian Myers +5Dental ImagingImage Captioning

  24. VisionPangu: A Compact and Fine-Grained Multimodal Assistant with 1.7B Parameters

    Mar 5, 2026Jiaxin Fan, Wenpo SongVision-Language ModelsMultimodal Large Language Models

  25. Cross-modal Identity Mapping: Minimizing Information Loss in Modality Conversion via Reinforcement Learning

    Mar 2, 2026Haonan Jia, Shichao Dong, Xin Dong +6Image CaptioningModality Gap in VLMs

  26. Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model

    Feb 28, 2026Zihang Wang, Xu Li, Benwu Wang +7Autonomous Driving PlanningOff-Road Robot Navigation

  27. Hyperdimensional Cross-Modal Alignment of Frozen Language and Image Models for Efficient Image Captioning

    Feb 27, 2026Abhishek Dalvi, Vasant HonavarCross-Modal AlignmentVision-Language Alignment