Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 491

All topics

Zamba2-VL Technical Report
May 29, 2026Hassan Shapourian, Kasra Hejazi, Olabode M. Sule +1Vision-Language Models Efficient VLM Inference
Zyphra, San Francisco, CA
Hyperbolic and Evidence-Prioritized Experts for Large Vision-Language Models
May 29, 2026Zijie Zhou, Dandan Zhu, Hangxiangpan Wang +3Vision-Language Models Large Vision-Language Models
China University of Petroleum (Beijing) · Hainan Institute of China University of Petroleum (Beijing) · South China Normal University
Personalize Your Large Vision-language Models With In-context Prompt Tuning
May 29, 2026Yanshu Li, Jiaqian Li, Kuai Yu +4Vision-Language Models Large Vision-Language Models
Brown University · Columbia University · University of Alabama at Birmingham +2
"Înţelegi Româneşte?'' A Recipe for Romanian Vision-Language Models
May 29, 2026Mihai Masala, Marius Leordeanu, Mihai Dascalu +1VLM Evaluation Vision-Language Models
National University of Science and Technology POLITEHNICA Bucharest, Romania
Learning from Fine-Grained Visual Discrepancies: Mitigating Multimodal Hallucinations via In-Context Visual Contrastive Optimization
May 29, 2026Haolin Deng, Xin Zou, Zhiwei Jin +3Vision-Language Models Direct Preference Optimization
The Hong Kong University of Science and Technology (Guangzhou) · OPPO AI Center · The Hong Kong University of Science and Technology
What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness
May 29, 2026Yusheng He, Jizhe Zhou, Xia Du +3VLM Evaluation VLM Robustness
School of Computer Science, Engineering Research Center of Machine Learning and Industry Intelligence, Sichuan University, Chengdu, 610020, China · School of Computer and Information Engineering, Xiamen University of Technology, Xiamen, 361000, China · Department of Electrical and Computer Engineering, University of Hong Kong, Pok Fu Lam, Hong Kong, China +1
Diversity Matters: Revisiting Test-Time Compute in Vision-Language Models
May 29, 2026Yijie Tong, Yifan Hou, Shaobo Cui +2VLM Evaluation Vision-Language Models
ETH Zürich · Shanghai Jiao Tong University · EPFL
Seeing Isn't Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)?
May 28, 2026Yue Zhang, Zun Wang, Han Lin +3VLM Evaluation Spatial Reasoning Benchmarks
UNC Chapel Hill · Google Research
LoMo: Local Modality Substitution for Deeper Vision-Language Fusion
May 28, 2026Feng Han, Zhixiong Zhang, Zheming Liang +2Cross-Modal Learning VLM Robustness
Fudan University · Shanghai Innovation Institute · Shanghai Jiao Tong University +1
Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
May 28, 2026Chun-Hsiao Yeh, Shengyi Qian, Manchen Wang +3Vision-Language Models 3D Spatial Reasoning
FAIR at Meta · UC Berkeley · HKU
AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference
May 28, 2026Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan KandemirLLM Pruning Vision-Language Models
The Pennsylvania State University
On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training
May 28, 2026Xueqing Wu, Yu-Chi Lin, Kai-Wei Chang +1Supervised Fine-Tuning Vision-Language Models
University of California, Los Angeles
Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset
May 28, 2026Qian Chen, Xianyin Zhang, Yanzhi Liu +3VLM Evaluation Vision-Language Models
Qwen DianJin Team, Alibaba Cloud Computing
From Pixels to Words -- Towards Native One-Vision Models at Scale
May 27, 2026Haiwen Diao, Jiahao Wang, Penghao Wu +18Vision-Language Models Video-Language Models
S-Lab, NTU · SenseTime Research · 3DLUT
VLMs May Not Globally Enhance Human Alignment over LLMs During Natural Reading
May 27, 2026Jinzhou Wu, Zhengwu Ma, Jixing Li +2VLM Evaluation Vision-Language Models
Department of Mechanical and Vehicle Engineering, Chongqing University · Department of Linguistics and Translation, City University of Hong Kong · McGovern Institute for Brain Research, Massachusetts Institute of Technology
AREA: Attribute Extraction and Aggregation for CLIP-Based Class-Incremental Learning
May 27, 2026Zhen-Hao Xie, Yu-Cheng Shi, Da-Wei ZhouClass-Incremental Learning Vision-Language Models
School of Artificial Intelligence, Nanjing University, China · State Key Laboratory of Novel Software Technology, Nanjing University, China
When Discourse Pressures Conflict: Information Structure in Vision-Language Model Outputs
May 27, 2026Marcell Fekete, Johannes Bjerva, Tamás KáldiVLM Evaluation Visual Question Answering
Department of Computer Science, Aalborg University, Copenhagen, Denmark · Department of Psycholinguistics and Neurolinguistics, ELTE Research Centre for Linguistics, Budapest, Hungary · ELTE Bárczi Gusztáv Faculty of Special Needs Education, Budapest, Hungary
Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models
May 27, 2026Haozhan Shen, Tiancheng Zhao, Kangjia Zhao +1Vision-Language Models Visual Spatial Reasoning
Zhejiang University · Om AI Research · Binjiang Institute of Zhejiang University
Risk-aware Selective Prompting for Hallucination Mitigation in Large Vision-Language Models
May 27, 2026Yuang Huang, Yafeng Zhang, Yu ZilanVision-Language Models Hallucination in Language Models
Shanghai Jiao Tong University · iFLYTEK · Tsinghua University
Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models
May 27, 2026Landi He, Mingde Yao, Shawn Young +1Vision-Language Models Efficient VLM Inference
Shenzhen University of Advanced Technology · CUHK MMLab, CPII under InnoHK
ABot-OCR Technical Report
May 27, 2026Kaitao Jiang, Ruiyan Gong, Xiaolong Cheng +3Vision-Language Models Document Parsing
AMAP CV Lab Alibaba Group
Bounded-Compute Multimodal Regression for Product-Rating Prediction
May 26, 2026William Leach, Ru He, Sizhuo Ma +4Vision-Language Models VLM Adaptation
Snap Inc.
EdgeFlow: Edge-Map Augmented VLM-Based Flowchart Processing for Industrial Requirements Engineering
May 26, 2026Zhifei Dou, Shabnam Hassani, Ou WeiRequirements Engineering Vision-Language Models
Huawei Research Canada
Real Images, Worse Judgments: Evaluating Vision-Language Models on Concreteness and Imagery
May 26, 2026Yifan Jiang, Ruoxi Ning, Sheng Yao +1VLM Evaluation Vision-Language Models
University of Waterloo · Vector Institute
Can Retrieval Heads See Images? Multimodal Retrieval Heads in Long-Context Vision-Language Models
May 26, 2026Aaron Branson Cigres Li, Zhaowei Wang, Yu Zhao +9Vision-Language Models VLM Interpretability
1HKUST · University of Edinburgh · 4CUHK +2
Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generation
May 26, 2026Joseph Hoche, David Brellmann, Gianni FranchiVision-Language Models Large Vision-Language Models
AMIAD, Pôle Recherche, Palaiseau · Safran Tech · ENSTA Paris
TPS-Drive: Task-Guided Representation Purification for VLM-based Autonomous Driving
May 26, 2026Jiaxiang Li, Yumao Liu, Ke MaVision-Language Models VLMs for Autonomous Driving
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
Respecting Modality Gap in Post-hoc Out-of-distribution Detection with Pre-trained Vision-Language Models
May 26, 2026Yuanwei Hu, Bo Peng, Yadan Luo +3Vision-Language Models Test-Time Adaptation
University of Technology Sydney · The University of Queensland
DV-SFT: Direct Vision Supervision for Fine-Grained Visual Understanding
May 26, 2026Jianfei Zhao, Feng Zhang, Xin Sun +3Supervised Fine-Tuning Vision-Language Models
School of Computer Science and Technology, Beijing Institute of Technology · 2Zhongguancun Academy · 5Southeast Academy of Information Technology, Beijing Institute of Technology +2
FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling
May 26, 2026Guixian Xu, Yide Liang, Zeli Su +5VLM Evaluation Vision-Language Models
Hainan International College, Minzu University of China · School of Information Engineering, Minzu University of China · Institute of Automation, Chinese Academy of Sciences +1

May 29, 2026, cs.CVJ/K move · Enter open · S save

Zamba2-VL Technical Report

Hassan Shapourian, Kasra Hejazi, Olabode M. Sule, Beren Millidge

Zyphra, San Francisco, CA

Vision-Language Models Efficient VLM Inference Multimodal Foundation Models

Open paper AskPDF arXiv

We present Zamba2-VL, a suite of vision-language models built on Zamba2, a hybrid language-model architecture combining Mamba2 state-space layers with a small number of shared transformer blocks. Across a broad range of image understanding, reasoning, OCR, grounding, and counting benchmarks, Zamba2-VL is competitive with leading Transformer-based open-weight VLMs of comparable scale, including the Molmo2, Qwen3-VL, and InternVL3.5 families, and substantially outperforms prior SSM-based and hybrid VLMs such as VL-Mamba, Cobra, and mmMamba. Inheriting the near-linear prefill compute and small, near-constant recurrent state of its Zamba2 backbone, Zamba2-VL delivers roughly an order of magnitude lower time-to-first-token (TTFT) than these Transformer baselines at matched parameter scale, with the efficiency gap most pronounced at the smaller 1.2B and 2.7B scales most relevant to on-device and edge deployment. We release three models -- 1.2B, 2.7B, and 7B -- together with inference code at https://huggingface.co/collections/Zyphra/zamba2-vl.

Momentum

Related topics

Latest papers 491