Open-Vocabulary Segmentation

Follow this topic Ask about this topic

Momentum

2 papers in the last four weeks, down 78% on the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21

Latest papers 33

All topics

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers
Oct 1, 2026Cigdem Kokenoz, Amir Salarpour, Alkim Domeke +5Open-Vocabulary 3D Segmentation Interactive 3D Segmentation
Department of Automotive Engineering, Clemson University, Greenville, SC, USA. · School of Computing, Clemson University, Clemson, SC, USA.
When to Adapt: Multi-Signal Domain Shift Detection for Efficient Training-Free Adaptation in Open-Vocabulary Segmentation
Sep 29, 2026Michele Antonazzi, Alejandra C. Hernandez, José Araujo +2Mitigating Domain Shift Open-Vocabulary Segmentation
EECS and Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden · Ericsson Research, Ericsson AB, Stockholm, Sweden
EviSplat: Preserving Multi-View Evidence in 3D Gaussian Splatting for Open-Vocabulary Segmentation
Sep 28, 2026Sungho Moon, Kota Shimomura, Junwoo Park +4Open-Vocabulary 3D Segmentation 3D Scene Understanding
DGIST, Daegu, Republic of Korea · Chubu University, Japan · Elith Inc., Japan +2
Preference-Guided Adaptation for Open-Vocabulary Semantic Segmentation via Prompt Disagreement
Sep 28, 2026Hyun-Kurl Jang, Jihun Kim, Kuk-Jin YoonOpen-Vocabulary Segmentation Semantic Segmentation
Visual Intelligence Lab. KAIST
HyperCLIP++: Fine-tuning CLIP forOpen-vocabulary Semantic Segmentation in Hyperbolic Space
Sep 21, 2026Zelin Peng, Zhengqin Xu, Changsong Wen +4Contrastive Language-Image Pre-Training Model Open-Vocabulary Segmentation
MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China · State Key Laboratory of Infrared Physics, Shanghai Institute of Technical Physics, Chinese Academy of Science, Shanghai, 200083, China · Meituan, Shanghai, 200051, China
ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentation
Sep 14, 2026Qiangqiang Zhou, Wenjun Tang, Yong Chen +2Open-Vocabulary Segmentation Vision-Language Alignment
School of Artificial Intelligence, Jiangxi Normal University · Institute of AI Education, East China Normal University
Towards Continual Test-Time Adaptation of Vision-Language Models in Open-Vocabulary Semantic Segmentation
Aug 30, 2026Chandler Timm C. Doloriel, Yunbei Zhang, Sarthak Kumar Maharana +5Vision-Language Model Adaptation Open-Vocabulary Segmentation
Faculty of Science and Technology (REALTEK), Norwegian University of Life Sciences (NMBU) · Tulane University · University of Texas at Dallas
Learning from Multimodal Pseudo-Labels for Robust Open-Vocabulary Instance and Panoptic Segmentation
Aug 12, 2026Duy Tran Thanh, Yeejin Lee, Byeongkeun KangOpen-Vocabulary Segmentation Panoptic Segmentation
Department of Electronic Engineering, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul, 01811, South Korea · Department of Electrical and Information Engineering, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul, 01811, South Korea · School of Electrical and Electronics Engineering, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul, 06974, South Korea
GeoSeg-OV: Bridging Geospatial Gaps with Structural Guidance for Open-Vocabulary Remote Sensing Segmentation
Aug 11, 2026Ruizhong Liu, Tingzhang Luo, Zaiyan Zhang +4Open-Vocabulary Segmentation Remote Sensing Image Segmentation
School of Computer Science, China University of Geosciences, Wuhan 430074, Hubei, China · Systems Hub, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, Guangdong, China · Department of Computer Science, City University of Hong Kong, Hong Kong, China +3
Test-Time Prototype Adaptation for Open-Vocabulary Semantic Segmentation
Aug 8, 2026Haozhe Wang, Jintao Cheng, Weibin Li +1Open-Vocabulary Segmentation Semantic Segmentation
South China Normal University · The Hong Kong University of Science and Technology
MAVISEG: Manifold Propagation and Visual Prototypes for Zero-Shot Open-Vocabulary Segmentation in Diffusion Transformers
Aug 6, 2026Rajatsubhra Chakraborty, Xujun Che, Ritabrata Chakraborty +2Open-Vocabulary Segmentation Diffusion Transformers
University of North Carolina at Charlotte, Charlotte, NC, USA · Manipal University Jaipur, Jaipur, Rajasthan, India
SCI-CLIP: Segment-Centric Inference with Reference Memory for Training-Free Open-Vocabulary Segmentation
Aug 6, 2026Mohamad Zamini, Diksha ShuklaOpen-Vocabulary Segmentation Frozen Contrastive Language-Image Pre-Training Visual Encoder
University of Wyoming Laramie, WY
Perceptual Anchoring: Prototype-Guided Text Calibration for Training-free Open-Vocabulary Semantic Segmentation
Aug 4, 2026Wanli Ma, Jiangwen Lu, Qinmu Peng +1Open-Vocabulary Segmentation Text Embeddings
School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China · National Anti-counterfeit Engineering Research Center, Huazhong University of Science and Technology, Wuhan 430074, China · School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China
Standalone DINOv3 for Training-Free Open-Vocabulary Semantic Segmentation in Remote Sensing
Aug 4, 2026Changhao Zhao, Haoxiang Li, Yuke Li +2Open-Vocabulary Segmentation Semantic Segmentation
College of Resources and Environment, Huazhong Agricultural University, Wuhan 430070, China
EOVSAM: Efficient Open-Vocabulary Segmentation with SAM 3 in One Pass
Aug 3, 2026Haomin Peng, Yongkang Li, Zhaoxiang Liu +4Open-Vocabulary Segmentation Open-Vocabulary
Huazhong University of Science and Technology · Data Science & Artificial Intelligence Research Institute, China Unicom · Unicom Data Intelligence, China Unicom +1
Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion
Jul 28, 2026Junhyuk Heo, Junghwan ParkRemote Sensing Image Segmentation Open-Vocabulary Segmentation
TelePIX, Seoul, Republic of Korea
DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation
Jul 23, 2026Sung-Hoon Yoon, Hoyong Kwon, Changgyoon Oh +1Open-Vocabulary Segmentation Image-Text Alignment
Multimodal Intelligence and Perception Lab., DGIST, Republic of Korea · Visual Intelligence Lab., KAIST, Republic of Korea
Prompt-Calibrated SAM 3 for Open-Vocabulary Remote Sensing Semantic Segmentation
Jun 20, 2026Yanghui Song, Nanqing Liu, Haonan Yin +3Open-Vocabulary Segmentation Semantic Segmentation
School of Information Science and Technology, Yunnan Normal University, Kunming, China · School of Computer Science and Engineering, Beihang University, Beijing, China · College of Computer Science, Beijing University of Technology, Beijing, China
ActiveSAM: Fast and Accurate Open-Vocabulary Semantic Segmentation with Frozen SAM 3
Jun 15, 2026Tran Dinh Tien, Zhiqiang ShenOpen-Vocabulary Segmentation
VILA Lab, Mohamed bin Zayed University of Artificial Intelligence
Learning a Semantic Calibration Network for Open-Vocabulary Semantic Segmentation
Jun 6, 2026Yang Sun, Tao Wang, Anastasia Ioannou +1Open-Vocabulary Segmentation Disambiguation
College of Computer and Data Science, Fuzhou University, Fuzhou, China. · School of Computer and Big Data, Minjiang University, Fuzhou, China. · Department of Computer Science and Engineering, European University Cyprus, Nicosia, Cyprus.
SparseSAM: Structured Sparsification of Activations in Segment Anything Models
May 17, 2026Hoai-Chau Tran, Chi H. Nguyen, Duy M. H. Nguyen +3Dynamic Sparse Attention Segment Anything Model
University of Illinois at Urbana-Champaign · VinUni-Illinois Smart Health Center, VinUniversity · College of Engineering & Computer Science, VinUniversity +3
SegRAG: Retrieval Augmented Spatial Prompting for Open Vocabulary Semantic Segmentation
May 17, 2026Abderrahmene Boudiaf, Irfan Hussain, Sajid JavedOpen-Vocabulary Segmentation Semantic Segmentation
Khalifa University, United Arab Emirates.
WOW-Seg: A Word-free Open World Segmentation Model
May 16, 2026Danyang Li, Tianhao Wu, Bin Li +5Open-Vocabulary Segmentation Visual Place Recognition
2VCIP, CS, Nankai University · 1NKIARI, Shenzhen Futian · 3AAIS, Nankai University +2
Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation
May 15, 2026Chenhao Wang, Yingrui Ji, Yu Meng +1Open-Vocabulary Segmentation Vision-Language Alignment
Aerospace Information Research Institute, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Zhejiang University
VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference
May 12, 2026Hao Zhu, Shuo Jin, Wenbin Liao +4Open-Vocabulary Segmentation Visual In-Context Learning
Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China · XJTLU +1
Qwen3-VL-Seg: Unlocking Open-World Referring Segmentation with Vision-Language Grounding
May 8, 2026Yuan Yao, Qiushi Yang, Humen Zhong +5Open-Vocabulary Segmentation Vision-Language Model Grounding
Tongyi Lab, Alibaba Group
DouC: Dual-Branch CLIP for Training-Free Open-Vocabulary Segmentation
Apr 27, 2026Mohamad Zamini, Diksha ShuklaOpen-Vocabulary Segmentation Frozen Contrastive Language-Image Pre-Training Visual Encoder
Department of Electrical Engineering and Computer Science, University of Wyoming, Laramie, WY, USA.
Diffusion Model as a Generalist Segmentation Learner
Apr 27, 2026Haoxiao Wang, Antao Xiang, Haiyang Sun +8Open-Vocabulary Segmentation Diffusion Models
Zhejiang University · South China University of Technology · Nanjing University +1
CoCo-SAM3: Harnessing Concept Conflict in Open-Vocabulary Semantic Segmentation
Apr 21, 2026Yanhui Chen, Baoyao Yang, Siqi Liu +1Open-Vocabulary Segmentation Open-Vocabulary
School of Computers, Guangdong University of Technology · Shenzhen Research Institute of Big Data · Peking University
SENSE: Stereo OpEN Vocabulary SEmantic Segmentation
Apr 17, 2026Thomas Campagnolo, Ezio Malis, Philippe Martinet +1Open-Vocabulary Segmentation Semantic Segmentation
ACENTAURI · Centre Inria d’Universite Cote d’Azur, France · NXP Semiconductors, France
Towards Realistic Open-Vocabulary Remote Sensing Segmentation: Benchmark and Baseline
Apr 17, 2026Bingyu Li, Tao Huo, Haocheng Dong +4Remote Sensing Image Segmentation Open-Vocabulary Segmentation
Department of Electronic Engineering and Information Science, University of Science and Technology of China, China · Institute of Artificial Intelligence (TeleAI), China Telecom, P. R. China · School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, China
JOPP-3D: Joint Open Vocabulary Semantic Segmentation on Point Clouds and Panoramas
Mar 6, 2026Sandeep Inuganti, Hideaki Kanayama, Kanta Shimizu +4Open-Vocabulary 3D Segmentation Open-Vocabulary Segmentation
German Research Center for Artificial Intelligence, DFKI, Germany · RPTU Kaiserslautern, Germany · Ricoh Company, Ltd. Japan +1
TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorization
Dec 2, 2024Hugo Malard, Michel Olvera, Stephane Lathuiliere +1Open-Vocabulary Segmentation Neural Audio
LTCI, Télécom Paris, Institut Polytechnique de Paris

Oct 1, 2026, cs.CVJ/K move · Enter open · S save

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

Cigdem Kokenoz, Amir Salarpour, Alkim Domeke, Christopher Salas+4

Department of Automotive Engineering, Clemson University, Greenville, SC, USA. · School of Computing, Clemson University, Clemson, SC, USA.

Open-Vocabulary 3D Segmentation Interactive 3D Segmentation Open-Vocabulary Segmentation Transformer Architectures

Open paper AskPDF arXiv

Accurate 3D semantic perception is critical for safe autonomous navigation. However, supervised LiDAR segmentation remains tied to closed taxonomies and to the cost of point-wise manual annotation. Open-vocabulary methods avoid that cost by projecting the output of 2D vision-language models onto LiDAR and distilling it into a 3D network. These methods rely almost exclusively on voxel-based sparse convolutions, and point transformers have so far been limited to indoor environments, where 3D data is dense and bounded. We present Lang3DSeg, which establishes a point transformer as the backbone for annotation-free open-vocabulary segmentation of outdoor 3D LiDAR, and is trained from scratch without geometric pre-training. This training paradigm necessitates addressing the inherent noise in 2D-to-3D label projections; specifically, naive projection often suffers from depth ambiguity, where points behind an object are erroneously assigned its semantic label. We therefore composite masks using an explicit class-priority rule and truncate each projected instance at the first gap in its depth distribution, correcting the projection error directly rather than averaging it over registered sequences. Lang3DSeg achieves 52.8% mIoU on nuScenes validation and 41.4% on SemanticKITTI, the highest among published annotation-free methods on both benchmarks. Every 3D semantic segmentation is on a single LiDAR sweep, and inference operates in real-time without running vision-language models.

Momentum

Related topics

Latest papers 33