Image Captioning

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, down 12% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 59

All topics

Image Bitstream Fine-grained Understanding for Privacy-Friendly AIoT
Oct 6, 2026Zhen Yu, Wenyang Liu, Kejun Wu +3Image Captioning Privacy-Preserving ML
School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China · School of Electrical and Electronics Engineering, Nanyang Technological University, Singapore · School of Electronic Information, Central South University, Changsha 410083, China +1
PAIQ: Patch-Aligned Semantic Injection via Residual Rotation
Sep 29, 2026Pinze Ren, Yuwei Zhang, Hao Chen +3Visual Question Answering Image Captioning
Tsinghua University · Nanyang Technological University
Momentum-Coupled Rubric Adaptation for Detailed Image Captioning
Sep 29, 2026Zhenwen Ji, Lei Jin, Shanyong Wang +6Image Captioning Rubric-Based RL
Xiaohongshu Inc. · the Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University
Reassessing Global Gradient-Norm Imbalance in BLIP Fine-Tuning Across Physical Domains
Sep 20, 2026Kiran Naseer, Samreen Azhar, Dwarikanath MahapatraImage Captioning VLM Adaptation
Department of Computer Science, University of Gujrat, Pakistan · Department of Computer Science, Khalifa University, Abu Dhabi, UAE
Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint
Sep 17, 2026Zhiyun Jiang, Hanyong Wang, Binbin Liang +3Image Captioning Vision-Language Models
Sichuan University, Chengdu, China · Beijing Institute of Technology, Beijing, China
Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge
Sep 16, 2026Dayoung Kil, Seong-heum KimOpen-Vocabulary Object Detection Efficient Multimodal Inference
Department of Intelligent Semiconductors, Soongsil University, Seoul, Republic of Korea
PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection
Sep 16, 2026Sara Pieri, Evangelos Kazakos, Shizhe Chen +2Image Captioning Panoptic Segmentation
Inria, École normale supérieure, CNRS, PSL Research University · Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague
Human-Centric Image Captioning with Subject-Centered Spatial Understanding
Sep 8, 2026Bozhou Li, Jiahang Zhang, Yue Ding +11VLM Evaluation Image Captioning
Peking University · Kling Team · Beijing, China +5
Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning
Sep 1, 2026Jiyoung Park, InJae Oh, Jung Uk KimImage Captioning Mixture of Experts
Kyung Hee University, Yong-in, South Korea
Controllable Image Captioning with Prompt-Conditioned Scene Rewards
Sep 1, 2026Jongyeop Hyun, Taeyoung Kim, Hyounghun KimImage Captioning RL for VLMs
Graduate School of Artificial Intelligence, POSTECH · Department of Computer Science and Engineering, POSTECH
ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs
Sep 1, 2026Yuta Kato, Shintaro Ozaki, Kazuki Hayashi +4Retrieval-Augmented Generation Image Captioning
The University of Tokyo · Nara Institute of Science and Technology (NAIST)
A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss
Sep 1, 2026Suryaansh Jain, Rahasya Barkur, Vishal G +8Contrastive Learning Image Captioning
University of Massachusetts Amherst · Adobe Research
Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors
Aug 13, 2026LingKai BuImage Captioning Object Hallucination in VLMs
Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioning
Aug 12, 2026Aysha Ashraf, Shaina Ashraf, Wafaa I. M. Hussin +3Image Captioning Remote Sensing Image Change Captioning
University of Electronic Science and Technology of China · School of Information and Communication Engineering, Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 611731, China · University of Bonn +2
CapProbe: Evaluating Detailed Image Captions via Full-Scene Dense Question Answering
Aug 11, 2026Mouxiao Huang, Qiangyu Yan, Borui Jiang +1VLM Evaluation Image Captioning
Huawei Technologies
MMArt: A Multi-Perspective Multimodal Dataset for Visual Art Understanding
Aug 11, 2026Shuai Wang, Wangyuan Ding, Yixian Shen +5Image Captioning Vision-Language Models
University of Amsterdam, Amsterdam, The Netherlands · Amazon AGI, United States of America · College of Business and Economics, University of Johannesburg, South Africa
CAPEval: A Decoupled Caption Evaluation across Understanding and Generation
Aug 3, 2026Zhipeng Liu, Haochen Wang, Zhaoxiang ZhangImage Captioning T2I Generation
University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences
Entity-Faithful Repair of Synthetic Supervision for Zero-Shot Image Captioning
Aug 2, 2026Zhiyue Liu, Wenkai Zhou, Jian Qin +1Synthetic Data Augmentation Image Captioning
School of Computer, Electronics and Information Guangxi Key Laboratory of Multimedia Communications and Network Technology Guangxi University Nanning, Guangxi, China
Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning
Jul 31, 2026Duy Tran Thanh, Thien-Phuc Doan, Long Nguyen-Vu +1Image Captioning Vision-Language Alignment
AI Platform OneNexus, OneMount · School of Electronic Engineering, Soongsil University, Seoul 06978, South Korea · AI Laboratory, MoAdata, Seoul, South Korea +1
Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation
Jul 30, 2026Simone Giano, Lorenzo Severini, Alessandro Galdelli +1Cross-Modal Knowledge Distillation Image Captioning
aDipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, Ancona, 60121, Marche, Italy
Towards Faithful Sentimental Image Captioning via Evidence-Aware Multi-Agent Reasoning
Jul 28, 2026Tiecheng Cai, Zexian Yang, Chao Chen +2Image Captioning Vision-Language Grounding
College of Computer and Data Science, Fuzhou University Fuzhou, China · School of Computer Science and Technology, Harbin Institute of Technology Shenzhen, China
A Reconstruction-Based Framework for Caption Evaluation Beyond Reference Captions
Jul 25, 2026Zhijiang Tang, Jiaxin Qi, Kaihua Tang +2Image Captioning Automated Evaluation
2Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, China · 1Computer Network Information Center, Chinese Academy of Sciences, China · 3Tongji University, China +1
Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models
Jul 10, 2026Shravan Murlidaran, Miguel P. EcksteinVLM Evaluation Image Captioning
aPsychological & Brain Sciences, University of California, Santa Barbara, , Santa Barbara, 93106, California, USA · bDepartment of Computer Science, University of California, Santa Barbara, , Santa Barbara, 93106, California, USA · cDepartment of Electrical and Computer Engineering, University of California, Santa Barbara, , Santa Barbara, 93106, California, USA
LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning
Jul 3, 2026Licheng Zhang, Siew-Kei Lam, Naveed AkhtarRemote Sensing Image Understanding Image Captioning
School of Computing and Information Systems, The University of Melbourne, Melbourne, 3010, Victoria, Australia · Nanyang Technological University, Singapore · The University of Melbourne, Melbourne, 3010, Victoria, Australia
Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing
Jul 2, 2026Licheng Zhang, Bach Le, Pengtao Zhao +1Image Captioning Automated Software Testing
School of Computing and Information Systems, University of Melbourne, Melbourne, Australia
Rigel: Self-Distilled Score Adaptation for Image and Video Captioning Evaluation
Jun 29, 2026Shuitsu Koyama, Kazuki Matsuda, Yuiga Wada +3Image Captioning Video Captioning
Keio University
CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation
Jun 27, 2026Jinhong Hu, Xiaoping Wang, Shuyin Huang +3Image Captioning Image Segmentation
College of Computer Science and Electronic Engineering, Hunan University, China · Guangxi Minzu University, China · National University of Defense Technology, China
VisChronos: Revolutionizing Image Captioning Through Real-Life Events
Jun 23, 2026Phuc-Tan Nguyen, Hieu Nguyen, Minh-Triet Tran +1Image Captioning
University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
MIRCaps: A Large-Scale Mixed-Domain Dataset with Image-Level and Region-Level Captions for Fine-Grained Vision-Language Learning
Jun 19, 2026Arlindo Luciano Tulumba Roberto, Hyungjoon KimImage Captioning
Changwon National University Changwon City, South Korea
PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models
Jun 17, 2026Yueyi Sun, Yuhao Wang, Jason Li +8Efficient Multimodal Inference Image Captioning
Peking University MSALab, ByteDance

Oct 6, 2026, cs.CVJ/K move · Enter open · S save

Image Bitstream Fine-grained Understanding for Privacy-Friendly AIoT

Zhen Yu, Wenyang Liu, Kejun Wu, Chengwang Xiao+2

School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China · School of Electrical and Electronics Engineering, Nanyang Technological University, Singapore · School of Electronic Information, Central South University, Changsha 410083, China+1

Image Captioning Privacy-Preserving ML

Open paper AskPDF arXiv

Image Bitstream Fine-grained Understanding (IBFU) aims to directly perform fine-grained classification and semantic description generation from encoded image byte sequences. In contrast to conventional pixel-domain visual understanding, IBFU conducts semantic analysis without fully decoding images into the pixel domain. Since pixel-level visual content is not explicitly reconstructed during inference, this paradigm reduces visual exposure within the processing pipeline and suits privacy-friendly Artificial Intelligence of Things (AIoT) applications. In this paper, we propose Bitstream Fine-grained Generator (BFG), a novel foundation model tailored for IBFU. BFG consists of two main components: a Bitstream Semantic Encoder (BSeE) and a Fine-grained Semantic Generator (FSeG). BSeE directly models semantic representations from encoded image bitstreams without explicit pixel reconstruction, while FSeG transforms the extracted bitstream semantics into detailed natural-language descriptions through autoregressive generation. To train BFG and comprehensively evaluate IBFU in practical AIoT scenarios, where image bitstreams may suffer corruption during transmission and storage, we construct a large-scale Corrupted-bitstream Fine-grained Understanding dataset (CFU-D), containing both intact bitstreams and corrupted variants across multiple corruption types and severity levels. Experiments show that BFG maintains stable fine-grained caption generation under bitstream corruption. For example, the performance only has slight change from 0.6339 to 0.6077 in terms of average CIDEr score on Stanford Dogs Caption dataset, while vision-language models, such as Qwen-VL-Chat, BLIP-2, GLM, Gemini, and GPT suffer severe performance decrease. This paper provides a practical paradigm for privacy-friendly fine-grained understanding in AIoT.

Momentum

Related topics

Latest papers 59