VLM Evaluation

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

70 papers in the last four weeks, up 67% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 649

All topics

A General-Purpose VLM Can Teach an Astronomy Foundation Model to Better Recognize Galaxy Morphology
Aug 3, 2026Dichang Zhang, Jiaqi Deng, Yixuan Shao +7VLM Evaluation AI-Assisted Scientific Research
Department of Computer Science Stony Brook University Stony Brook, New York, USA · School of Computer Science University of Technology Sydney Sydney, New South Wales, Australia · Futurewei Technologies San Jose, California, USA
Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction
Aug 3, 2026Priyashree Roy, Sujitha Martin, Mohammad Rostami +6VLM Evaluation Document Understanding
Amazon Web Services
Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit
Aug 3, 2026Xiaohao Yang, Aohua Tian, Derek Van Berkel +2VLM Evaluation Vision-Language Models
School for Environment and Sustainability; School of Information University of Michigan, Ann Arbor, USA
Evaluating VLMs on Multimodal Aristotelian Persuasion Tasks
Aug 2, 2026Khondoker Ittehadul IslamVLM Evaluation Vision-Language Models
Saarland University · Department of Language Science & Technology
It's the Decoding Format, Not the Perturbation: Auditing Consistency-Based Selection for Vision-Language Test-Time Scaling
Aug 2, 2026Puzhuo Zheng, Hasan KurbanVLM Evaluation Self-Consistency Decoding
College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking
Aug 2, 2026Timothee Mickus, Claudio Savelli, Eduardo Calò +10VLM Evaluation Hallucination Detection in VLMs
University of Helsinki
Cross-Task Dissociation in Frontier Vision-Language Model Theory of Mind
Jul 31, 2026Kejia Zhang, Youran Sun, Chugang Yi +1VLM Evaluation Theory of Mind
University of Maryland, College Park
Sycophancy Undermines Epistemic Vigilance in Cooperative Vision-Language Tasks
Jul 31, 2026Rupak Sarkar, Neha Srikanth, Saloni Gupta +3VLM Evaluation Vision-Language Models
University of Maryland, College Park · Army Research Lab
Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?
Jul 31, 2026Wenzhuo Zhao, Xiuzhi Li, Zhongkuan Mao +6VLM Evaluation Salient Object Detection
College of Computer Science, Sichuan University, China · National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, China · School of Information and Communication Engineering, University of ElectronicScience and Technology of China, China
SciFigPlag-Bench: A Benchmark for Provenance-Aware Scientific Figure Plagiarism Detection
Jul 31, 2026Zhiying Cui, Minghao Yang, Linlin Gao +2VLM Evaluation Image Forgery Detection
1Ningbo University · 2Hokkaido University · 3IBM Research
OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
Jul 30, 2026Qiushi Sun, Kanzhi Cheng, Yian Wang +20VLM Evaluation Computer-Use Agent Benchmarks
The University of Hong Kong · Nanjing University · National University of Singapore +4
Scaling Vision-Language Models Is Not Enough to Mitigate Bias
Jul 30, 2026Ioannis Sarridis, Ioannis Kompatsiaris, Symeon PapadopoulosVLM Evaluation VLM Robustness
Information Technologies Institute, CERTH Thessaloniki, Greece
MemeBench: What LVLMs Miss When Interpreting Culture-Dependent Memes
Jul 30, 2026Weihang Wang, Kainan Tu, Jielei Zhang +9VLM Evaluation Vision-Language Models
1Bilibili · 2Fudan University · 3Peking University
Can LVLMs Uncover the Truth Behind Visual Illusions? An Analysis of Perceptual and Reasoning Capabilities
Jul 30, 2026Liangjie Zhao, Jiaqing Lyu, Kexin Tang +5VLM Evaluation Visual Reasoning
Adelaide University · Tsinghua University · Amap, Alibaba Group +3
JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles
Jul 30, 2026Shawn Li, Wei Yang, Jike Zhong +11VLM Evaluation Spatial Reasoning Benchmarks
University of Southern California · National University of Singapore · Adobe Research +3
Witness Evidence Portfolios: Single-Prefill Risk Detection for Closed Multimodal Answers
Jul 30, 2026Fexiang Liu, Shiye Wang, Qiang Qiu +1VLM Evaluation Multimodal Large Language Models
1State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences
HumanCLAW: Can Vision-Language Models Act Through a Body?
Jul 29, 2026Li Siyao, Jiawei Gu, Shuai Liu +15VLM Evaluation Embodied AI
Meta · University of Washington · Nanyang Technological University +2
Visual Credit Audit for Multimodal Spatial Reasoning
Jul 29, 2026Feixiang Liu, Qiang Qiu, Lanbo Sun +3VLM Evaluation Spatial Reasoning Benchmarks
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences
Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inference
Jul 29, 2026Feixiang Liu, Qiang Qiu, Hao Zhang +1VLM Evaluation Efficient VLM Inference
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences
OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observation
Jul 29, 2026Kaiyu Li, Zepeng Xin, Zixuan Jiang +4VLM Evaluation Open-Vocabulary Object Detection
Xi’an Jiaotong University
Hearsay: Vision-Language Medical Diagnoses Without an Image
Jul 29, 2026Siddharth VohraVLM Evaluation Medical Image Analysis
Carnegie Mellon University Pittsburgh, PA, USA · Amazon Web Services AI Native Pittsburgh, PA, USA
Level, Sharpness, and Corpus: Why Zero-Shot OOD Detector Rankings Do Not Transfer
Jul 29, 2026Ignacio M. De la Jara, Cristian Rodriguez-Opazo, Stephen Gould +1VLM Evaluation Distribution Shift Detection
University of Adelaide · 3Naval Group Pacific · 2Australian National University
An evolutionary model of animats with VLM-based subjective evaluation
Jul 29, 2026Shota Miyazaki, Takaya Arita, Reiji SuzukiVLM Evaluation Robotics
Graduate School of Informatics, Nagoya University, Japan
Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models
Jul 28, 2026Jiaang Li, Chengzu Li, Zhaochong An +4VLM Evaluation Multimodal Large Language Models
University of Copenhagen · University of Cambridge · 3ETH Zürich +1
Evaluating VLMs for Autonomous Agent-Driven Geometry Clipping Detection in Video Game QA
Jul 28, 2026Carlos Celemin, Benedict Wilkins, Adrián Barahona-Ríos +2VLM Evaluation VLM Robustness
Sony Interactive Entertainment, London, United Kingdom
Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact
Jul 28, 2026Mateusz KozłowskiVLM Evaluation Radiology VLMs
Independent Researcher, Kraków, Poland
ERUnderstand: Evaluating Vision-Language Models on Structured ER Diagrams
Jul 27, 2026Ali Ansari, Yasmin Mohammadi, Farnoush Nili +3VLM Evaluation Document Image Understanding
Temple University · Department of Computer and Information Sciences · Philadelphia, PA, USA
When Low CER is Not Enough: An Analysis of Hallucinations in Vision-Language OCR Systems on Historical Uruguayan Documents
Jul 27, 2026Marina Gardella, Camilo Mariño, Diego Belzarena +3VLM Evaluation VLM Hallucination
CB · Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, France · UDELAR, CB +4
Cheap Probes Predict Expensive Training in 3D-CT Vision--Language Models
Jul 24, 2026Renjie LiangVLM Evaluation Medical VLMs
University of Florida, Gainesville, FL, USA
Be Consistent! Enhancing Robust Visual Reasoning in LVLMs with Consistency Constraints
Jul 23, 2026Liqiang Jing, Xiong Zhou, Siddharth Varia +3VLM Evaluation Visual Reasoning
University of Texas at Dallas · Amazon Web Services

Aug 3, 2026, cs.CVJ/K move · Enter open · S save

A General-Purpose VLM Can Teach an Astronomy Foundation Model to Better Recognize Galaxy Morphology

Dichang Zhang, Jiaqi Deng, Yixuan Shao, Yuanpeng Liu+6

Department of Computer Science Stony Brook University Stony Brook, New York, USA · School of Computer Science University of Technology Sydney Sydney, New South Wales, Australia · Futurewei Technologies San Jose, California, USA

VLM Evaluation AI-Assisted Scientific Research VLM Distillation

Open paper AskPDF arXiv

Existing astronomy foundation models provide strong galaxy representations, but adapting them to new survey conditions and survey-specific morphology recognition tasks still requires substantial human supervision. We show that VLM-based VQA systems contain meaningful visual-semantic priors that can serve as weak supervision for downstream morphology classifiers and improve morphology classification under limited human-label budgets. We first introduce a survey-oriented VQA benchmark spanning two representative imaging regimes and evaluate state-of-the-art VLMs on galaxy morphology questions. The results show that these models capture useful morphology signals and informative uncertainty, but are not sufficiently reliable to replace human annotators. Motivated by this finding, we use a general-purpose VLM as a morphology teacher for Zoobot, an astronomy foundation model pretrained on large-scale Galaxy Zoo annotations. Across two survey domains and multiple annotation budgets, the VLM teacher consistently improves Zoobot's downstream morphology classification. These results demonstrate that a general-purpose VLM provides knowledge complementary to an astronomy foundation model and can teach it to better recognize galaxy morphology under limited human supervision. The resulting pipeline is designed for label-efficient adaptation to forthcoming large-scale surveys, including the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) and the Nancy Grace Roman Space Telescope. The benchmark and code are publicly available at https://github.com/fw-ic/VLM-morphology-teacher.

Momentum

Related topics

Latest papers 649