Visual Representation Learning

Follow this topic Ask about this topic

Momentum

28 papers in the last four weeks, up 367% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 146

All topics

Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension
Jul 6, 2026Lian Xu, Mohammed Bennamoun, Farid Boussaid +3Visual Representation Learning Vision-Language Grounding
The University of Western Australia · Murdoch University · Sun Yat-sen University +1
Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation
Jul 3, 2026Chaofan Gan, Zicheng Zhao, Yuanpeng Tu +6Visual Representation Learning Diffusion Transformer
Shanghai Jiao Tong University, Shanghai, China · The University of Hong Kong, Hong Kong, China · Monash University, Melbourne, Australia +2
Transformer Geometry Observatory TGO-II: Representational Similarity Observatory
Jul 2, 2026Kaustubh Kapil, Kishor P. UplaIntrinsic Dimensionality Representational Similarity Analysis
Department of Electronics Engineering Sardar Vallabhai National Institute of Technology (SVNIT), Surat, India
LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives
Jul 1, 2026Lukas Kuhn, Giuseppe Serra, Randall Balestriero +1Visual Representation Learning Vision-Language Pretraining
German Cancer Research Center · German Cancer Consortium · Brown University +1
Identifying Latent Concepts and Structures for Generalized Category Discovery
Jul 1, 2026Boyang Dai, Chaoqi Chen, Yizhou YuRepresentation Learning Visual Representation Learning
1The University of Hong Kong · 2Shenzhen University
Cross-Resolution Semantic Transfer for Robust Text-to-Image Retrieval in Low-Resolution Surveillance
Jun 29, 2026Wenjie Qian, Bin Yang, Xiao Wang +4Visual Representation Learning Cross-Modal Retrieval
𝑎School of Computer Science and Technology, Wuhan University of Science and Technology · 𝑏School of Computer Science, National Engineering Research Center for Multimedia Software, Wuhan University · 𝑐Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology
ViQ: Text-Aligned Visual Quantized Representations at Any Resolution
Jun 25, 2026Xumin Yu, Zuyan Liu, Zhenyu Yang +5Visual Representation Learning Multimodal Pretraining
Tencent HY Vision Team · Tsinghua University · Institute of Automation, CAS +1
Meta-learning as a principle for human-like visual representations
Jun 24, 2026Can Demircan, Marcel Binz, Alireza Modirshanechi +1Visual Representation Learning Meta-Learning
Helmholtz Munich, Munich, Germany · Max Planck Institute for Biological Cybernetics, Tübingen, Germany
Semantic Allocation in Ordered Bottlenecks: Predictive Residual Inference for Visual Representation Learning
Jun 23, 2026Erik Ayari, Manuel Traub, Martin V. ButzRepresentation Learning Visual Representation Learning
Neuro-Cognitive Modeling Group, University of Tübingen, Tübingen, Germany
Learning Diachronic Representations of Ancient Greek Letterforms
Jun 23, 2026John Pavlopoulos, Spyros Barbakos, Lavinia Ferretti +7Representation Learning Visual Representation Learning
Athens University of Economics and Business, Greece · Archimedes, Athena Research Center, Greece · Department of Computer and Systems Sciences, Stockholm University, Sweden +5
Learning Entropy Signature for Image Representation and Classification
Jun 21, 2026Jan Glaser, Ivo Bukovsky, Noriyasu Homma +1Visual Representation Learning Image Classification
Dpt. of Applied Mathematics Czech Technical University in Prague Prague, Czech Republic · Dpt. of Computer Science University of South Bohemia in Ceske Budejovice Ceske Budejovice, Czech Republic · Dpt. of Radiological Imaging and Informatics Tohoku University Graduate School of Medicine Sendai, Japan
A scalar per patch from pre-trained ViTs enables fast moving navigation in the real world
Jun 19, 2026Steeven Janny, Leonid Antsfeld, Christian WolfVisual Representation Learning Robot Navigation
NaverLabs Europe, Grenoble, France
Language-Instructed Vision Embeddings for Controllable and Generalizable Perception
Jun 17, 2026Chengzhi Mao, Xudong Lin, Wen-Sheng ChuVisual Representation Learning Vision Foundation Model Adaptation
Google
LARE: Low-Attention Region Encoding for Text-Image Retrieval
Jun 17, 2026Abdulmalik Alquwayfili, Faisal Almeshal, Jumanah Almajnouni +8Visual Representation Learning Fine-Grained Image Retrieval
Saudi Data and Artificial Intelligence Authority (SDAIA), Riyadh, Saudi Arabia.
Contrastive Action-Image Pre-training for Visuomotor Control
Jun 15, 2026Yuvan Sharma, Dantong Niu, Anirudh Pai +16Contrastive Learning Visual Representation Learning
1UC Berkeley · 2NVIDIA · 3Sapienza University of Rome +2
The Importance of Phase in Neural Representations: An Internal Oppenheim-Lim Test of Image Classifiers
Jun 15, 2026Alper YıldırımVisual Representation Learning Frequency-Domain Feature Learning
Hierarchical Fine-Grained Aerial Object Detection
Jun 15, 2026Yan Zhang, Fang Xu, Wen Yang +1Visual Representation Learning Hierarchical Representation Learning
School of Computer Science, Wuhan University, Wuhan, 430072, China · School of Artificial Intelligence, Wuhan University, Wuhan, 430072, China · School of Electronic Information, Wuhan University, Wuhan, 430072, China
You Don't Need Strong Assumptions: Visual Representation Learning via Temporal Differences
Jun 14, 2026Ninad Daithankar, Alexi Gladstone, Yann LeCun +1Visual Representation Learning Video Representation Learning
1UIUC · 2New York University
Analyzing Visual Aircraft Representations with Sparse Autoencoders
Jun 13, 2026Deepshik SharmaVisual Representation Learning Sparse Autoencoders
Department of Computer Science & Engineering · Jain University, Bangalore, India
Rethinking Implicit Spatial Representation in Visuomotor Policy Learning
Jun 13, 2026Xiangyu Chen, Yuxuan Hu, Chuhao Zhou +1Visual Representation Learning Visuomotor Policy Learning
MARS Lab, Nanyang Technological University
Beyond Scalar Distances: Semantic Attribute Gradients from Frozen MLLMs for Visual Embeddings
Jun 13, 2026Shubhang Bhatnagar, Dheeraj Baiju, Narendra AhujaVisual Representation Learning Fine-Grained Image Retrieval
University of Illinois Urbana-Champaign
Unlocking Latent Dimensions: Exploring Representations of Large-Scale X-ray Scattering Data using Variational Autoencoders
Jun 12, 2026Monika Choudhary, Xiaoya Chong, Runbo Jiang +25Variational Autoencoders Visual Representation Learning
RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers
Jun 12, 2026Timing Yang, Predrag Neskovic, Jansen Seheult +4Visual Attention Visual Representation Learning
1Johns Hopkins University · 2Office of Naval Research, Arlington, VA · Department of Laboratory Medicine and Pathology, Mayo Clinic,FLOPs (G)MN, USA
IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder
Jun 9, 2026Yitong Chen, Zijie Diao, Junke Wang +5Visual Representation Learning Image Tokenization
Institute of Trustworthy Embodied AI, Fudan University · Shanghai Innovation Institute · University of Maryland, College Park
Lighting-Aware Representation Learning under Controllable Lighting Variation
Jun 5, 2026Lizhen Zhu, Charantej Reddy Pochimireddy, James Z Wang +1Contrastive Learning Visual Representation Learning
Department of Informatics and Intelligent Systems, College of Information Sciences and Technology, The Pennsylvania State University, University Park, PA, 16802, USA · Department of Psychology, College of the Liberal Arts, The Pennsylvania State University, University Park, PA, 16802, USA
Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learning
Jun 3, 2026Deepika SN Vemuri, Sayanta Adhikari, Ankit Saha +2Visual Representation Learning Interpretable ML
IIT Hyderabad · Amazon, India · KLA +1
Stateful Visual Encoders for Vision-Language Models
Jun 3, 2026Zirui Wang, Junwei Yu, Adam Yala +3Vision-Language Models Visual Representation Learning
1Voio, Inc. · 2UC Berkeley · 3UCSF
Formalizing the Binding Problem
Jun 2, 2026Lianghuan Huang, Yihao Li, Saeed Salehi +3Visual Representation Learning Vision Transformer
Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA, USA · Department of Computer and Information Science, University of Pennsylvania · Machine Learning Group, Technical University of Berlin, Berlin, Germany +3
Beyond Compression: Quantifying Spectral Accessibility in Vision Representations
Jun 2, 2026Akayou A. Kitessa, Yijun ZhaoVisual Representation Learning Frequency-Domain Feature Learning
Fordham University New York City, NY
PRISM: Progressive Reasoning through Iterative Slot Memory for Vision
May 29, 2026Ziyu Wang, Shuangpeng Han, Mengmi ZhangVisual Representation Learning Visual Reasoning
Deep NeuroCognition Lab, Nanyang Technological University, Singapore
DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation
May 28, 2026Jusuk Lee, Seungjae Lee, Jonghun Shin +6Cross-Modal Learning Cross-Modal Representation Learning
Seoul National University · University of Maryland, College Park · Georgia Institute of Technology
Deep Psychovisual Image Representations
May 28, 2026Wendi Ma, Aryaman Sharma, Wei Dai +1Visual Representation Learning Frequency-Domain Feature Learning
School of EECS, The University of Queensland
Misalignment Between Backpropagation and the Hierarchy of Brain Responses to Images
May 27, 2026Joséphine Raugel, Maximilian Seitzer, Marc Szafraniec +6Backpropagation Visual Representation Learning
Meta AI · Ecole Normale Supérieure, PSL University
Structure over Pixels: Learning Variable-Length Visual Programs
May 26, 2026Piotr Wyrwiński, Kacper Dobek, Krzysztof KrawiecVisual Representation Learning Image Tokenization
Institute of Computing Science Poznan University of Technology, Poznan, Poland
Uncertainty-DTW for Sequences and Visual Tokens
May 24, 2026Lei Wang, Syuan-Hao Li, Yongsheng Gao +1Dynamic Time Warping Visual Representation Learning
School of Engineering and Built Environment, Electrical and Electronic Engineering, Griffith University · School of Computer Science and Engineering, University of New South Wales
Vision Transformers Need Better Token Interaction
May 22, 2026Linxiang SuVisual Representation Learning Vision Transformer
University of Szeged
Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot
May 22, 2026Jorge Chang Ortega, Bastien Le Lan, Thomas Serre +1Visual Representation Learning Energy-Based Models
ANITI · Brown University, ANITI · CNRS, ANITI
Cross-Species RSA Reveals Conserved Early Visual Alignment but Divergent Higher-Area Rankings Across Human fMRI and Macaque Electrophysiology
May 21, 2026Nils LeuteneggerRepresentational Similarity Analysis Visual Representation Learning
Independent Researcher, Switzerland
TextTeacher: What Can Language Teach About Images?
May 21, 2026Tobias Christian Nauen, Stanislav Frolov, Brian Bernhard Moser +3Cross-Modal Knowledge Distillation Visual Representation Learning
RPTU University Kaiserslautern-Landau · German Research Center for Artificial Intelligence (DFKI)
RiT: Vanilla Diffusion Transformers Suffice in Representation Space
May 21, 2026Le Zhang, Ning Mang, Aishwarya AgrawalFlow Matching Visual Representation Learning
Mila – Québec AI Institute, UdeM · Utrecht University · Canada CIFAR AI Chair
Beyond Routing: Characterising Expert Tuning and Representation in Vision Mixture-of-Experts
May 20, 2026Gene Tangtartharakul, Katherine R. StorrsVisual Representation Learning Mixture of Experts
School of Psychology · University of Auckland · Auckland, New Zealand
Capability $\neq$ Interpretability: Human Interpretability of Vision Foundation Models
May 19, 2026Julien Colin, Lore Goetschalckx, Nuria Oliver +1Visual Representation Learning Vision Foundation Models
ELLIS Alicante, Spain · imec, Leuven, Belgium · Brown University, USA
KappaPlace: Learning Hyperspherical Uncertainty for Visual Place Recognition via Prototype-Anchored Supervision
May 19, 2026Maya Yanko, Yoli ShavitVisual Representation Learning Visual Place Recognition
Faculty of Engineering Bar-Ilan University Ramat Gan, Israel
PEIRA: Learning Predictive Encoders through Inter-View Regressor Alignment
May 17, 2026Michael Arbel, Basile Terver, Jean PonceUnsupervised Learning Visual Representation Learning
Univ. Grenoble Alpes, Inria · CNRS, Grenoble INP, LJK · Ecole Normale Supérieure / PSL +2
Characterizing the visual representation of objects from the child's view
May 14, 2026Jane Yang, Tarun Sepuri, Alvin Wei Ming Tan +3Representation Learning Visual Representation Learning
Department of Psychology, University of California San Diego · Department of Psychology, Stanford University · Department of Computer Science, Stanford University
Rethinking the Good Enough Embedding for Easy Few-Shot Learning
May 13, 2026Michael Karnes, Alper YilmazVisual Representation Learning Few-Shot Learning
The Ohio State University, Columbus, OH 43210, USA
Characterizing Universal Object Representations Across Vision Models
May 13, 2026Florian P. Mahner, Johannes Roth, Ka Chun Lam +3Visual Representation Learning Representation Alignment
Vision and Computational Cognition Group Max Planck Institute Justus-Liebig-University Giessen · Machine Learning Core National Institute of Mental Health Bethesda, MD, USA · Department of Cognitive Science Johns Hopkins University Baltimore, MD, USA
Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores
May 12, 2026Alan Z. Song, Yinjie Chen, Mu Nan +3Visual Representation Learning Vision Transformer
Carnegie Mellon University · University of Hong Kong
WorldComp2D: Spatio-semantic Representations of Object Identity and Location from Local Views
May 12, 2026SeongMin Jin, Doo Seok JeongRepresentation Learning Visual Representation Learning
1Division of Materials Science and Engineering · Department of Semiconductor Engineering
Weather-Robust Cross-View Geo-Localization via Prototype-Based Semantic Part Discovery
May 12, 2026Chi-Nguyen Tran, Dao Sy Duy Minh, Huynh Trung Kiet +3Cross-View Geo-Localization Visual Representation Learning
Faculty of Information Technology, University of Science, Vietnam National University, Ho Chi Minh City, Vietnam. · Department of Computer Science, University of Warwick, Coventry, United Kingdom.
FeatMap: Understanding image manipulation in the feature space and its implications for feature space geometry
May 11, 2026Elias B. Krey, Nils Neukirch, Nils StrodthoffNeural Representation Geometry Visual Representation Learning
Division AI4Health Carl von Ossietzky Universität Oldenburg Oldenburg, Germany
Learning to Align Generative Appearance Priors for Fine-grained Image Retrieval
May 11, 2026Shijie Wang, Yadan Luo, Zijian Wang +2Visual Representation Learning Fine-Grained Image Retrieval
The University of Queensland, Australia · The University of Adelaide, Australia
Lost or Hidden? A Concept-Level Forgetting in Supervised Continual Learning
May 10, 2026Katarzyna Filus, Kamil Faber, Roberto Corizzo +1Visual Representation Learning Continual Learning
Institute of Theoretical and Applied Informatics Polish Academy of Sciences, Gliwice, Poland · AGH University of Krakow Krakow, Poland · American University Washington DC, USA +1
SEMASIA: A Large-Scale Dataset of Semantically Structured Latent Representations
May 10, 2026Mario Edoardo Pandolfo, Enrico Grimaldi, Lorenzo Marinucci +4Neural Representation Geometry Visual Representation Learning
Dept. Computer, Control and Management Engineering, Sapienza University of Rome, Rome, Italy. · National Inter-University Consortium for Telecommunications (CNIT), Parma, Italy. · Dept. of Statistical Sciences, Sapienza University of Rome, Rome, Italy. +1
3D MRI Image Pretraining via Controllable 2D Slice Navigation Task
May 7, 2026Yu Wang, Qingchao ChenVisual Representation Learning Self-Supervised Pre-Training
Beijing University of Posts and Telecommunications · Peking University
Look Beyond Saliency: Low-Attention Guided Dual Encoding for Video Semantic Search
May 7, 2026Faisal Aljehrai, Mohammed A. Alkhrashi, Alreem Almuhrij +6Visual Representation Learning Information Retrieval
Saudi Data And Artificial Intelligence Authority (SDAIA)
CRISP: Compositional Relations as Invariant Structural Priors for Domain Generalization
May 7, 2026Dat Nguyen, Duc-Duy NguyenRepresentation Learning Visual Representation Learning
Harvard University Basis Research Institute · Hanoi University of Science and Technology
MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality
May 7, 2026Panqi Yang, Haodong Jing, Jiahao Chao +5Visual Representation Learning Image Tokenization
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence,National Engineering Research Center of Visual Information and Applications,and Institute of Artificial Intelligence and Robotics, Xi’an Jiao Tong University · Xiaohongshu Inc.
Extremely coarse learning objectives induce human-aligned representations in AI vision models
May 7, 2026Yash Mehta, Michael F. BonnerVisual Representation Learning Fine-Grained Image Classification
Department of Cognitive Science, Johns Hopkins University
Exploring Clustering Capability of Inpainting Model Embeddings for Pattern-based Individual Identification
May 6, 2026Jens van Bijsterveld, Daniele Avitabile, Fons J. Verbeek +1Biometric Identification Visual Representation Learning
Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands · Naturalis Biodiversity Center, Leiden, The Netherlands · 1Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands +2

Jul 6, 2026, cs.CVJ/K move · Enter open · S save

Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension

Lian Xu, Mohammed Bennamoun, Farid Boussaid, Hamid Laga+2

The University of Western Australia · Murdoch University · Sun Yat-sen University+1

Visual Representation Learning Vision-Language Grounding Vision-Language Alignment

Open paper AskPDF arXiv

Referring expression comprehension (REC) aims to localize the object in an image described by natural language. In Weakly supervised REC (WREC), existing approaches primarily operate on anchor-level visual representations. Even when enriched with auxiliary cues, relational interactions remain implicitly encoded within individual anchor features. The resulting visual representation remains flat and unary-only, limiting its ability to align with the structured nature of language. In this work, we propose a Structured Visual Compositional Representation (SVCR) learning framework for WREC. Rather than implicitly encoding relations within unary anchors, the proposed SVCR explicitly models both unary object embeddings and pairwise relational embeddings, forming a structured visual representation space. We further introduce a compositional alignment mechanism that matches unary and pairwise visual representations with their corresponding textual embeddings in a unified manner, enabling compositional visual-textual matching under weak supervision. Extensive experiments on RefCOCO, RefCOCO+, and RefCOCOg show that the proposed SVCR achieves state-of-the-art performance. These results demonstrate the effectiveness of explicit structured visual representations and visual-textual alignment for WREC.

Momentum

Related topics

Latest papers 146