Fine-Grained Visual Perception

Overview

Fine-grained visual perception is about recognizing details that broad scene understanding can miss, such as small attributes, object parts, subtle differences between images, and the locations of specific objects. Approaches include part- and attribute-based representations, hierarchical classification, dense visual-language alignment, and adaptive region selection that zooms or searches for task-relevant evidence. Benchmarks test fine-grained recognition, high-resolution question answering, open-vocabulary detection, visual grounding, counting, and controlled image comparisons across domains such as vehicles, food, medicine, and aerial imagery. A central challenge is that strong language and general vision abilities do not guarantee reliable use of local visual evidence: models may overlook details or rely on semantic shortcuts, while added resolution, model scale, or reasoning does not consistently solve the problem.

Latest papers

CardsList

165 papers10 papers in the last four weeks, down 44% on the four weeks before. 0.1% of all new papers.

  1. R3^{3}Sieve: Suppressing Unconditional Information from Attention to Answers for High-Resolution VQA

    Nov 18, 2026Yifan Cao, Yawen Zhang, Xiaocui Yang +6Visual Question AnsweringVisual Evidence Sensitivity in VLMs

  2. vividRGB: Various visual cue detection in RGB photographs with forced focused attention

    Nov 16, 2026Masahiro RyoFine-Grained Visual PerceptionEdge Inference

  3. ReAccess: Look Once, Stay Focused with Efficient Test Time Memory

    Nov 16, 2026Tianhao Chen, Yilong Fan, Yuheng Wu +2Memory-Augmented VLMsEfficient VLM Inference

  4. Gravity and Flight: Learning to Navigate Fine-Grained Remote Sensing Scenes

    Nov 12, 2026Yuheng Zong, Minghua Wang, Xin Zhao +3Remote Sensing VLMsReasoning for VLMs

  5. ZoomGain: Mining Global-to-Zoom Perception Gaps for Fine-Grained Visual Supervision

    Nov 10, 2026Haozhan Shen, Liangbo He, Jun Lan +4Fine-Grained Visual PerceptionVLM Evaluation

  6. Tiny Evidence Region Localization with Selective Contrastive On-Policy Self-Distillation

    Nov 7, 2026Yujuan Pang, Wenhao Xu, Yinglei TengVisual Evidence Sensitivity in VLMsFine-Grained Visual Perception

  7. Look Closer, Align Better: Explicit Visual Attributes for Robust EEG-to-Image Decoding

    Nov 6, 2026Ke Xiao, Banghua Yang, Wenbin Guo +1EEG-Based Visual DecodingVisual Representation Learning

  8. Sketch-Omni: Instance-Level Sketch-Based Visual Prompting for Perception MLLMs

    Nov 3, 2026Dongyu Wang, Dar-Yen Chen, Zhiming Hong +2Visual Prompt LearningFine-Grained Visual Perception

  9. Open-Weight MLLMs Cannot Compare What They Cannot Name

    Oct 30, 2026Wenxin Su, Anna KreshukMLLM EvaluationVision-Language Grounding

  10. Nereus: A Large-Scale Underwater Dataset for Fine-Grained Attribute Understanding and Grounded Counting Perception

    Oct 30, 2026Jingtao Deng, Zihao Jin, Yuehe Chen +3Multimodal DatasetFine-Grained Visual Perception

  11. FieldGuideRAG: Image-Grounded GraphRAG for Fine-Grained Recognition with Vision-Language Models

    Oct 29, 2026Jiacheng Ding, Yanliang Qi, Cong Guo +1Graph Retrieval-Augmented GenerationGraph-Based Retrieval

  12. Look at Where You Think: Localization-Head Alignment for Fine-Grained Perception in Thinking VLMs

    Oct 29, 2026Yuan Wang, Wei Wu, Hongning WangFine-Grained Visual PerceptionReasoning for VLMs

  13. WeVisOne-VL: Unified Visual Perception from Objects to Pixels

    Oct 22, 2026Tianming Liang, Junyi Pan, Yuxi Li +5Image MattingFine-Grained Visual Perception

  14. VisualWorldBench: A Fine-Grained Multi-Task Benchmark for Evaluating Visual World Knowledge in MLLMs

    Oct 14, 2026Chen Chen, Zheming Liang, Jiaqi WangVLM EvaluationKnowledge-Based Visual Question Answering

  15. From Glance to Focus: Mitigating Recognition Laziness in MLLMs for Fine-Grained Recognition

    Oct 9, 2026Yutong Yang, Zhuqi Liu, Mouxing Yang +1Multimodal Large Language ModelsFine-Grained Visual Perception

  16. ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentation

    Oct 8, 2026Ruicheng Zhang, Kaiwen Shen, Jiaqi Hou +6Referring Expression SegmentationReferring Image Segmentation

  17. Mixture of Layers: Dynamic Layer Routing for Visual Reasoning

    Oct 7, 2026Jeonghwan Kim, Sofia Stoica, Jiwan Chung +5VLM ReasoningLarge Vision-Language Models

  18. Unlocking Fine-Grained Perception in CLIP via Structurally-Aware Latent Masked Modeling

    Oct 6, 2026Juntong Li, Lingwei Dang, Haomin Wu +3VLM AdaptationDense Prediction

  19. EviRover: Reinforcing Agentic Perception Beyond a Glance

    Sep 30, 2026Kaixuan Fan, Kaituo Feng, Tianshuo Peng +4Tool-Using Vision-Language AgentsActive Visual Perception

  20. GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives

    Sep 30, 2026Qize Yu, Lianrui Fan, Boyu Chen +23Vision-Language GroundingVLMs for Robotics

  21. EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perception

    Sep 29, 2026Yaoxin Niu, Zhangquan Chen, Yang Zhang +5VLM AdaptationEfficient ViTs

  22. Why MLLMs Struggle to Count: Overcoming Individuation and Aggregation Bottlenecks with ConvStack

    Sep 29, 2026Liwei Che, Yihao Quan, Sen Fang +4Object CountingMultimodal Large Language Models

  23. Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision

    Sep 28, 2026Hanoona Rasheed, Mohammed Irfan Kurpath, Bin Ren +3Vision Foundation ModelsLarge Vision-Language Models

  24. VD-DeepStack: Bridging Visual Comparison and Language Reasoning for Few-Shot Anomaly Detection

    Sep 28, 2026Mengyang Zhao, Zhuolin He, Haiyang Yu +9Few-Shot Anomaly DetectionVisual Reasoning

  25. Evidence-Aligned Multimodal On-Policy Self-Distillation for Fine-Grained Visual Understanding

    Sep 28, 2026Nanxing Hu, Qiwei Yan, Jinchao Zhang +1On-Policy Self-DistillationVLM Distillation

  26. Not All Confusion Is Equal: A Source-Aware Uncertainty Diagnosis for Fine-Grained Aircraft Detection

    Sep 24, 2026Hai Huang, Helmut MayerObject DetectionFine-Grained Visual Perception

  27. BAS-OPD: Budget-Aware Selective On-Policy Self-Distillation for Fine-Grained Multimodal Perception

    Sep 22, 2026Zihan Chen, Hengguang Zhou, Yuan Kang +5VLM DistillationMultimodal Large Language Models