Vision Encoders

Ask about this topic

Momentum

30 papers in the last four weeks, up 200% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 153

All topics
CardsList

  1. Video Encoders Built on Image Representations

    Oct 5, 2026Jusheng Zhang, Wenhao Wang, Longqi Cai +3Vision Encoders

    Stanford University · Vast Intelligence Lab · Google DeepMind

  2. A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models

    Oct 4, 2026Yilin Yang, Jun-Tao Tang, Kengyi Wang +3Vision Encoders

    School of Artificial Intelligence, Shanghai Jiao Tong University · Nanjing University · Fudan University +1

  3. eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routing

    Oct 1, 2026Dehao Huang, Jianbang Liu, Jianpan Gao +7Diffusion-Based Vision-Language-ActionsOffline Reinforcement Learning

    Southern University of Science and Technology, Shenzhen, China. · Beijing Zhongguancun Academy, Beijing, China. · Samsung Robotics eXperience. +2

  4. CoVisco: Codec-Native Vision Encoder with Native Token Compression for Unified Image-Video Understanding

    Sep 30, 2026Yulong Liu, Xiaotian Han, Junyuan Shang +6Vision EncodersToken Compression

    ERNIE Team, Baidu Inc. · The Hong Kong University of Science and Technology · Institute of Automation, Chinese Academy of Sciences (CASIA)

  5. MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation

    Sep 30, 2026Ivan Martinović, Josip Šarić, Yuki M. Asano +1Panoptic SegmentationDomain Adaptation

    Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, Croatia. · Faculty of Computer and Information Science, University of Ljubljana, Večna Pot 113, 1000 Ljubljana, Slovenia. · Fundamental AI Lab, University of Technology Nuremberg, Dr.-Luise-Herzberg-Straße, 90461 Nürnberg, Germany.

  6. Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models

    Sep 30, 2026Shilinlu Yan, Bowen Chen, Yuechen Zhang +3Token CompressionVision Encoders

    Beijing University of Posts and Telecommunications · Jiangnan University · Nanyang Technological University +1

  7. PAIQ: Patch-Aligned Semantic Injection via Residual Rotation

    Sep 29, 2026Pinze Ren, Yuwei Zhang, Hao Chen +3Vision EncodersCross-Encoder

    Tsinghua University · Nanyang Technological University

  8. Structured Visual Target Learning For Cross-Subject eeg-to-image retrieval

    Sep 29, 2026Salini Yadav, Taveena Lotey, Mickaël Coustaty +2Electroencephalography DecodingVision Encoders

    Indian Institute of Technology Roorkee, India · University of La Rochelle, France · Indian Institute of Technology (ISM) Dhanbad, India

  9. How Medical VLMs Underutilize Their Vision Encoders: A Dermatology Perspective

    Sep 29, 2026Janet Wang, Yunbei Zhang, Xiao Wang +1Medical Vision-Language ModelsSkin Lesion Classification

    Tulane University · Oak Ridge National Laboratory

  10. Cross-attention encoding models reveal dynamic spatiotemporal routing across human higher visual cortex

    Sep 28, 2026Iishaan Inabathini, Margaret M. HendersonSpatio-Temporal AttentionHuman Visual Cortex

    Carnegie Mellon University

  11. EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Model

    Sep 28, 2026Rithvik Jonna, Man Namgung, Aakash Gurram +1Vision-Language NavigationResource-Constrained Edge Devices

    Department of Electrical and Computer Engineering Johns Hopkins University · Laboratory for Computational Sensing and Robotics Johns Hopkins University

  12. W2Rep: Learning Visual Representations by Watching the World Change

    Sep 28, 2026Wen Huang, Hang Guo, Jiarui Yang +3Fine-Grained Video UnderstandingVision Encoders

    Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Nankai University, Tianjin, China · Shenzhen University, Shenzhen, China

  13. How Far Are We from Removing the Visual Encoder? Scaling Laws for Encoder-Free Multimodal Pretraining

    Sep 28, 2026Lin Chen, Bolin Ni, Qi Yang +6Multimodal PretrainingMultimodal Large Language Models

    CASIA · UCAS · Foundation Model Department, Tencent

  14. WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policies

    Sep 28, 2026Lin Liu, Lu Zhang, Ziying Song +6Latent World ModelsVision Encoders

    School of Information and Communication Engineering Dalian University of Technology & Beta Infinity · School of Information and Communication, Engineering Dalian University of Technology · Nanyang Technological University +1

  15. ConvCue: Complementary Visual Inductive Biases for Vision-Language Models

    Sep 28, 2026Zixuan Lan, Shichu SunRecent Vision-Language ModelsVision Encoders

    The University of Chicago · University of Chinese Academy of Sciences

  16. IronViT: Toward Efficient Generalist Visual Representation Learning

    Sep 24, 2026Jiaxi Huang, Yueqi Hu, Xin Zhu +13Vision EncodersRepresentation Quality

    Robotics Foundation Model Team, Xpeng Inc.

  17. Less is More: Encoder-only Audio-Visual Segmentation

    Sep 24, 2026Ilpo Viertola, Vladimir Iashin, Sophie Tötterström +1Video Object SegmentationVision Encoders

    Tampere University

  18. Virtual Encoders in Multimodal Transformers

    Sep 22, 2026Katsuya Ogata, Yuta NakashimaDetection TransformerVision Encoders

    The University of Osaka

  19. RoboMP-DINOv2: Prompts, Not Filters for Robust Robot Manipulation

    Sep 22, 2026Han Qi, Heng YangVisuomotor ControlRobot Systems

    Harvard School of Engineering and Applied Sciences Harvard University

  20. Streaming Video Editing with Easy Adaptation

    Sep 21, 2026Yujia Hu, Jiajun Li, Zihao He +1Video EditingVideo Diffusion Models

    Shanghai Jiao Tong University

  21. Video-STLayout Pre-training

    Sep 21, 2026Akash Abdu Jyothi, Greg MoriFine-Grained Video UnderstandingVision Encoders

    School of Computing Science Simon Fraser University Burnaby, Canada

  22. Not All Layers Need Tuning: Diagnosing and Directing Adaptation in Vision-Language-Action Models

    Sep 16, 2026Shahram Najam Syed, Arthur Jakobsson, Prayuj Sachdev +1Vision-Language Model AdaptationDiffusion-Based Vision-Language-Actions

    Robotics Institute, Carnegie Mellon University, Pittsburgh, USA · Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, USA

  23. Tables Decoded: DELTA for Structure, TARQA for Understanding

    Sep 15, 2026Jahanvi Rajput, Dhruv Kudale, Saikiran Kasturi +2Tabular DataQuestion-Answering Benchmarks

    Indian Institute of Technology Bombay · IIT Bombay · BharatGen

  24. High-Fidelity Video Quality Assessment with VQA-Specific Saliency

    Sep 15, 2026Hakan Emre Gedik, Shashank Gupta, Alan BovikVideo QualityVision Encoders

    The University of Texas at Austin · University of Colorado Boulder

  25. Pre-PEFT Probing: Weight Statistics and Perturbation Robustness for Layer Selection in VLM Vision Encoders

    Sep 14, 2026Qingtao Xia, Jiahua Bao, Siyao Cheng +1Parameter-Efficient Fine-Tuning MethodsVision-Language Model Adaptation

    Faculty of Computing Harbin Institute of Technology Harbin, China

  26. What Makes an Efficient VLA? Navigating Action-Head Design, Scaling, and Latency

    Sep 12, 2026Luoyang Sun, Guoyang Xia, Fengfa Li +9Vision EncodersScaling

    Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences · AI Lab, The Yangtze River Delta +4

  27. HALDETECT at ImageEval 2026 Shared Tasks: Answer-First Contrastive Grounding with QLoRA

    Sep 12, 2026Syed Mohaiminul Hoque, Md Sakhawat HossainCitation Hallucination DetectionLarge Multimodal Models

    Independent Author

  28. BruNet: A Cross-Domain Transfer Framework for Bruise Segmentation

    Sep 11, 2026Qiming Wang, Richard J. Motley, Ebube E. Obi +2Skin Lesion ClassificationVision Encoders

    Cardiff University United Kingdom

  29. Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs

    Sep 9, 2026Killian Steunou, Yannis Tevissen, Mounîm A. El YacoubiAudio-Visual ReasoningVision Encoders

    SAMOVAR Laboratory, T´el´ecom SudParis, Institut Polytechnique de Paris, Palaiseau, France · Moments Lab, Paris, France

  30. Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap

    Sep 8, 2026Earl Ranario, Jared Smith, Lars Lundqvist +2Leaf Disease ClassificationPrecision Agriculture

    University of California, Davis

  31. Canonical Color as a Lens into Concept Decodability in Vision Encoders and VLMs

    Sep 8, 2026Xiaofu Chen, Stella Frank, Yova KementchedjhievaVision EncodersDecoding

    MBZUAI · Technical University of Denmark

  32. CoFiE: Coarse-to-Fine Evidence Selection for Efficient Streaming Video Understanding

    Sep 3, 2026Jing Jiang, Yiran Ling, Ruonan Li +2Streaming Video UnderstandingVision Encoders

    Harbin Institute of Technology · State Key Laboratory of Smart Farm Technologies and Systems · Pengcheng Laboratory

  33. Compressing AI Traffic: Standardized Neural Network Coding of Visual-Token Representations in Split Vision-Language Inference

    Sep 1, 2026Reza Heidari, Hamed R. Tavakoli, Juho KannalaToken CompressionVision Encoders

    Aalto University, Nokia Technologies · Nokia Technologies · Espoo, Finland +1

  34. Successive Capacity Growth: Task-Complexity-Driven Width and Depth Expansion for Vision Transformer Encoders in JEPA World Models

    Aug 27, 2026Frederik BerenzJoint-Embedding Predictive ArchitecturesVision Encoders

    121-labs.com Remscheid, Germany

  35. Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning

    Aug 20, 2026Haoqiang Kang, Yinpeng Chen, Luyang Liu +5Latent Visual ReasoningMultimodal Reasoning

    Google DeepMind · UC San Diego · Work done at Google DeepMind

  36. CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes

    Aug 19, 2026Kumal Hewagamage, Isuranga Senavirathne, Sasika Amarasinghe +44DVision Encoders

    University of Moratuwa, Sri Lanka · Singapore-MIT Alliance for Research & Technology (SMART) Centre, Singapore · Agency for Science, Technology and Research (A*STAR), Singapore

  37. PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation

    Aug 17, 2026Zhiyuan Yuan, Guanying Chen, Lingteng Qiu +3Monocular Depth EstimationDepth Estimation

    1Sun Yat-sen University · 3CUHKSZ · 2Shenzhen-FNii

  38. AVA-Encoder: Towards Agent-Native Video Representation Learning

    Aug 12, 2026Chuyue Li, Jinpeng Yu, Haozhe Wang +7Video AgentVision Encoders

    Qwen Business Unit of Alibaba · ShanghaiTech University · The Hong Kong University of Science and Technology +2

  39. G0.5: One Autoregressive Stream for Robot Reasoning and Action

    Aug 12, 2026Yicheng Liu, Zibin Dong, Baijun Ye +24Diffusion-Based Vision-Language-ActionsVision Encoders

    Galaxea Team

  40. Where To Look? : Causal Tracing of Vision Encoders in VLM

    Aug 11, 2026Naren Kumar S, Tirth Bhatt, Mayank SinghRecent Vision-Language ModelsVision Encoders

    LINGO Research Group, Indian Institute of Technology Gandhinagar, India

  41. Label-Free Parkinson's Disease Screening from Face and Voice through Mechanistic Interpretability

    Aug 10, 2026Jiaheng Su, Yu SunDiseaseScreening

    Independent Researcher, Los Angeles, CA, USA · California State Polytechnic University, Pomona, CA, USA

  42. UniSpace: Unified Visual Representation and Scalable Multimodal Modeling

    Aug 9, 2026Jinbo Yan, Limeng Qiao, Jie Qin +3Vision EncodersSelf-Supervised Vision Transformers

    Meituan

  43. Gaze Behavior in Visual World Experiments Can be Modeled With Off-the-shelf Language-Vision Encoders

    Aug 7, 2026Rahul Murali Shankar, Titus von der Malsburg, Sebastian PadóGaze BehaviorVision Encoders

    Computational Linguistics · University of Stuttgart, Germany · Linguistics

  44. Invisible Shortcuts: Why Vision Encoders Know Your Camera

    Aug 5, 2026Vladan Stojnić, Ryan Ramos, Giorgos Kordopatis-Zilos +2Vision EncodersEncoders

    VRG, FEE, Czech Technical University in Prague · The University of Osaka

  45. Unleashing the Potential of Vision-Language Models for Generalizable AI-Generated Image Detection

    Aug 5, 2026Weihan Cai, Hao Tan, Zichang Tan +2Ai-Generated Image DetectionVision Encoders

    State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · Sangfor Technologies Inc., Shenzhen 518055, China +1

  46. Dense Metric Depth Completion from Sparse Direct Time-of-Flight Sensors

    Aug 5, 2026Hakyeong Kim, Ruicheng Wang, Chengtang Yao +2Dense PredictionVision Encoders

    KAIST · USTC · Microsoft Research Asia

  47. Probabilistic Reachable-Action Verification of Visuomotor Policies via Set-Based Training

    Aug 3, 2026Yanliang Huang, Zhuocheng Zhang, Peng Xie +5Visuomotor PolicyReachability

    School of Computation, Information and Technology, Technical University of Munich, Munich, Germany · School of Engineering, Hainan Bielefeld University of Applied Sciences, Hainan, China

  48. Look Where It Matters: Adaptive Visual Refinement for Vision-Language-Action Models

    Aug 3, 2026Jin Cui, Yanbin Hu, Xinyue Long +3Diffusion-Based Vision-Language-ActionsVision Encoders

    1State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Software Engineering, Xi’an Jiaotong University

  49. HAFI-VLM: A Frequency Perspective for Diagnosing and Enhancing Visual Perception in Vision-Language Models

    Aug 3, 2026Jin Cui, Chuanchang Su, Jiayi Lu +3Ava-VlmVision Encoders

    1State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Computer Science and Technology, Xi’an Jiaotong University · School of Software Engineering, Xi’an Jiaotong University

  50. Location-Aware Fine-Grained Representation Learning for Medical Vision Foundation Models

    Aug 2, 2026Myeongkyun Kang, Yanting Yang, Xiaoxiao LiMedical Vision-Language ModelsVision Encoders

    The University of British Columbia · Vector Institute

  51. RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning

    Jul 31, 2026Qian Wang, Longrui Chen, Peiran Sun +8Visual Geometry Grounded TransformerRobotic Perception

    Karlsruhe Institute of Technology, Germany · University of Leeds, United Kingdom

  52. FibVLA: An Efficient Temporal Vision-Language-Action Model with Fibonacci Sampling

    Jul 31, 2026Li Lin, Wujun Xu, Weiwei Meng +3Vision EncodersEmbodied Artificial Intelligence

    Southeast University, Nanjing, Jiangsu, China · Nanyang Technological University, Singapore.

  53. MedARC: Training-Free Adaptive Redundancy Compression of Visual Tokens for 3D Medical Vision-Language Models

    Jul 29, 2026Yitao Zhu, Mengjun Liu, Yingji Fu +2Medical Vision-Language ModelsLong Visual-Token Sequences

    Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong · School of Integrated Circuits and Electronics, Beijing Institute of Technology, China · 3Mental Health Research Center, The Hong Kong Polytechnic University, Hong Kong +1

  54. Rethinking Expert Training for Model Merging with Prompt Learning

    Jul 27, 2026Christos Georgakilas, Aniello Panariello, Samir El Karrat Moreno +3Continual Model MergingContrastive Language-Image Pre-Training Model

    Computer Vision Center, Barcelona, Spain · Universitat Aut`onoma de Barcelona, Barcelona, Spain · AImageLab, University of Modena and Reggio Emilia, Italy

  55. MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoning

    Jul 27, 2026Shaofei LeiVision EncodersVisual Perception

  56. UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models

    Jul 25, 2026Ioannis Maniadis Metaxas, Adrian Bulat, Alberto Baldrati +4Vision EncodersRecent Vision-Language Models

    Samsung AI Cambridge · Technical University of Iasi · Queen Mary University of London

  57. LayoutLite: Token-Level Implicit Layout Analysis for Efficient Document OCR

    Jul 24, 2026Xudong Liu, Bicheng Wan, Yulin JinOptical Character RecognitionVision Encoders

    1Yuanli Technology (Beijing) Co., Ltd. · 2Beijing Normal University

  58. Multimodal Pretraining for Generalizable EEG Representation Learning

    Jul 23, 2026Targol Bakhtiarvand, Jugal Kalita, Adham AtyabiElectroencephalography Foundation ModelsSeizure Detection

    Department of Computer Science, University of Colorado Colorado Springs, Colorado Springs, CO, USA

  59. Sparse Concept Channels in Frozen 3D CT Vision Encoders

    Jul 23, 2026Farhad Nooralahzadeh, Lea Bogensperger, Christian Bluethgen +1Medical Vision-Language ModelsFrozen Encoder

    Department of Quantitative Biomedicine, University of Zurich, Switzerland · Center for Artificial Intelligence in Medicine and Imaging, Stanford University, USA

  60. Latent-Action-Guided Video-Language Feature Learning for Surgical Instrument-Tissue Interaction Recognition

    Jul 22, 2026Jiajun Cheng, Sainan Liu, Subarna Tripathi +2Diffusion-Based Vision-Language-ActionsVision Encoders

    Arizona State University, Tempe, AZ, USA · Intel Corporation, USA · University of California, Merced, CA, USA