3D Referring Segmentation

Follow this topic Ask about this topic

Latest papers

13 papers2 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

HumanSkill-4D: Training-Free Language Querying of Animatable Gaussian Avatars in Space and Time
Oct 17, 2026unsu Kim, Naeun Kim, Dongyoon Han +13D Referring Segmentation Human Avatar Animation
UNIST · NAVER AI Lab
FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity
Oct 16, 2026Yiqun Zhao, Jiachen Xu, Yihao Zhi +53D Part Segmentation 3D Referring Segmentation
The University of Hong Kong · Tencent Hunyuan · The Chinese University of Hong Kong, Shenzhen +1
DSSR-3D: Decoupled Reasoning for View-Dependent Referring in 3D Gaussians
Sep 3, 2026Thanh-Khoi Nguyen, Thien-Phuc Tran, Minh-Triet Tran3D Referring Segmentation 3D Visual Grounding
University of Science, Ho Chi Minh City, Vietnam · Viet Nam National University, Ho Chi Minh City, Vietnam
GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting
Aug 18, 2026Qijian Tian, Zimeng Wu, Xuhong Wang +23D Referring Segmentation Feed-Forward 3D Reconstruction
School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China · School of Computer Science and Engineering, Beihang University, Beijing 100191, China · Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China +1
Beyond Similarity Matching: Structured Reasoning for Open-Vocabulary Referring Segmentation in 3DGS
Aug 17, 2026Yizhao Wang, Xinfa Wang, Jingbo Wang +53D Referring Segmentation Referring Expression Segmentation
School of Computer Science, Henan Institute of Science and Technology
ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splatting
Jul 21, 2026Jiayu Ding, Meilu Song, Xiaoyi Zhang +33D Gaussian Splatting Open-Vocabulary 3D Segmentation
Peking University · North China Electric Power University · China University of Geosciences
Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors
Jun 29, 2026Jameel Hassan, Yasiru Ranasinghe, Vishal Patel3D Gaussian Splatting Open-Vocabulary 3D Segmentation
Johns Hopkins University
Segment and Select: Vision-Language Segmentation in 3D Scenarios
Jun 9, 2026Yulin Chen, Zhihang Zhong, Yuenan Hou3D Point Cloud Segmentation 3D Referring Segmentation
Shanghai AI Laboratory · University of Science and Technology of China · Shanghai Jiaotong University
TrackRef3D: Multi-View Consistent Track-then-Label for Open-World Referring Segmentation in 3D Gaussian Splatting
May 26, 2026Yuyang Tan, Renhe Zhang, Hang Zhang +2Multi-View Consistency 3D Gaussian Splatting
East China Normal University, Shanghai, China · Shanghai AI Laboratory · University of Electronic Science and Technology of China, Chengdu, China
3D Segmentation Using Viewpoint-Dependent Spatial Relationships
May 15, 2026Ayaka Nanri, Klara Reichard, Mert Kiray +33D Spatial Reasoning 3D Referring Segmentation
Institute of Science Tokyo · Technical University of Munich · BMW Group +12
PC-CrossDiff: Point-Cluster Dual-Level Cross-Modal Differential Attention for Unified 3D Referring and Segmentation
Mar 18, 2026Wenbin Tan, Jiawen Lin, Fangyong Wang +43D Referring Segmentation 3D Visual Grounding
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, Xiamen, China · School of Big Data, Tongren University, Tongren, China · Hanjiang National Laboratory, Wuhan, China +2
Hierarchical Collaborative Fusion for 3D Instance-aware Referring Expression Segmentation
Mar 6, 2026Keshen Zhou, Runnan Chen, Mingming Gong +13D Referring Segmentation Referring Expression Segmentation
The University of Sydney · The University of Melbourne · Mohamed bin Zayed University of Artificial Intelligence
3D-DRES: Detailed 3D Referring Expression Segmentation
Mar 3, 2026Qi Chen, Changli Wu, Jiayi Ji +23D Referring Segmentation Referring Expression Segmentation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · Shanghai Innovation Institute · National University of Singapore

Oct 17, 2026J/K move · Enter open · S save

HumanSkill-4D: Training-Free Language Querying of Animatable Gaussian Avatars in Space and Time

unsu Kim, Naeun Kim, Dongyoon Han, Seungryul Baek

UNIST · NAVER AI Lab

3D Referring Segmentation Human Avatar Animation

Open paper AskPDF arXiv

We introduce avatar referring segmentation, which selects regions of animatable Gaussian avatars from language queries. A query can also specify a pose or motion to select matching intervals. This lets users interact with avatars for local editing and motion inspection. However, making these selections with existing language Gaussian splatting methods poses two challenges: adjacent parts and garments are hard to separate and may be referred to indirectly (region ambiguity), while fine-grained motions can look alike in RGB (motion ambiguity). We address these challenges with HumanSkill-4D, a training-free framework that shares a multimodal large language model (MLLM) and geometric operators across avatars. For each avatar, a semantic memory links body-part and garment categories to persistent Gaussian regions and appearance descriptions. The MLLM uses category names and descriptions to select categories by appearance, relation, or function. To find matching intervals, it composes operators into programs that check query conditions on driving joint trajectories stored in a motion memory. These category choices and operator outputs make selections traceable, while composing or adding operators supports new motion conditions. To evaluate this task, we introduce three human-annotated benchmarks and show that HumanSkill-4D outperforms the baselines in part segmentation and 3D and 4D referring segmentation, with compact memories and only minutes of setup per avatar.