Panoptic Segmentation

Ask about this topic

Overview

Panoptic segmentation combines semantic segmentation of background-like regions (“stuff”) with instance segmentation of countable objects (“things”), giving a unified account of a scene. Common approaches use query-based transformer decoders, unified-kernel models, and temporal or geometric association, with extensions to open-vocabulary recognition, 3D point clouds, video, and multi-view scenes. Methods are commonly evaluated with Panoptic Quality on benchmarks such as COCO, Cityscapes, and ScanNet, while video and driving settings also test temporal consistency and robustness to adverse conditions. A central challenge is maintaining accurate, consistent instance identities while recognizing unfamiliar objects and meeting the efficiency and annotation constraints of real-world deployment.

Latest papers

CardsList

38 papers7 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. Spherical Geometry-Aware Panoptic Scene Graph Generation for Equirectangular Panoramas

    Oct 20, 2026Zhe Wu, Xiaoyan Fei, Xinyi Jiang +4Scene Graph GenerationPanoptic Segmentation

    Shanghai DianJi University, Shanghai, China · University of Minnesota Twin Cities, Minneapolis, MN, USA

  2. PanoGraphGS: Unifying Panoptic Segmentation and Hierarchical 3D Scene Graphs with Gaussian Splatting

    Oct 20, 2026Jinghan Gao, Siyu Wang, Dongyu Feng +23D SGG3D Scene Understanding

    Zhejiang Humanoid Robot Innovation Center, Ningbo, China.

  3. Real-Time Radar Semantic and Panoptic Scene Understanding

    Oct 19, 2026Santosh Parit, Julia Hindel, Rohit Mohan +4Autonomous Driving PerceptionPanoptic Segmentation

    University of Freiburg · University of Oxford

  4. Every View Counts: View-Consistent Panoptic Quality for Multi-view Panoptic Segmentation

    Oct 5, 2026Youngmin Lee, Byungha Ko, Guhnoo Yun +1Multi-View ConsistencyPanoptic Segmentation

    Korea University · Korea Institute of Science and Technology

  5. MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation

    Sep 30, 2026Ivan Martinović, Josip Šarić, Yuki M. Asano +1Panoptic SegmentationUnsupervised Domain Adaptation

    Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, Croatia. · Faculty of Computer and Information Science, University of Ljubljana, Večna Pot 113, 1000 Ljubljana, Slovenia. · Fundamental AI Lab, University of Technology Nuremberg, Dr.-Luise-Herzberg-Straße, 90461 Nürnberg, Germany.

  6. Hard-Region Supervision: #1 on the Waymo Open Dataset 2D Video Panoptic Segmentation Leaderboard

    Sep 30, 2026Jinghan YangPanoptic SegmentationVideo Object Segmentation

  7. ProGuT: Label-Efficient Panoptic Segmentation for Forest Scenes

    Sep 29, 2026Pankaj Deoli, Karsten BernsImage SegmentationPanoptic Segmentation

    Robotics Research Lab, RPTU Kaiserslautern-Landau Gottlieb-Daimler-Str. 48, 67663 Kaiserslautern, Germany

  8. PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

    Sep 16, 2026Sara Pieri, Evangelos Kazakos, Shizhe Chen +2Image CaptioningPanoptic Segmentation

    Inria, École normale supérieure, CNRS, PSL Research University · Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague

  9. CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

    Sep 11, 2026Jonathan Sauder, Thomas Ruckli, Gabrielė Strodomskytė +17Panoptic SegmentationInstance Segmentation

    MIT · EPFL · University of Djibouti +7

  10. PolarSym: Polar Geometry-aware Attention for CAD Floorplan Parsing

    Aug 12, 2026Kerui Chen, Yiqing Wang, Kangzhou Xin +2Panoptic SegmentationTransformer Attention

    School of Computer and Information Engineering, Henan University of Economics and Law, Zhengzhou, China · Third Dimension (Henan) Software Technology, Zhengzhou, China

  11. Learning from Multimodal Pseudo-Labels for Robust Open-Vocabulary Instance and Panoptic Segmentation

    Aug 12, 2026Duy Tran Thanh, Yeejin Lee, Byeongkeun KangPanoptic SegmentationInstance Segmentation

    Department of Electronic Engineering, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul, 01811, South Korea · Department of Electrical and Information Engineering, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul, 01811, South Korea · School of Electrical and Electronics Engineering, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul, 06974, South Korea

  12. iFAN: Inference-Aware Learning for Plain Mask Transformers

    Aug 4, 2026Fang Li, Yu He, Haoyang Tong +7Panoptic SegmentationInstance Segmentation

    University of Chinese Academy of Sciences · Xi’an Jiaotong University · Beijing Institute of Technology

  13. PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series

    Aug 1, 2026Xuechen LiPanoptic SegmentationAgricultural Remote Sensing

    University of Minnesota Minneapolis, MN, USA

  14. SAFViT: Spatial Attention Fusion Gating for Vision Transformer-Based Nucleus Segmentation and Classification

    Jul 30, 2026Harshit Mittal, Arash RabbaniPanoptic SegmentationHistopathology Image Segmentation

  15. DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving

    Jul 28, 2026Yung-Hsu Yang, Luigi Piccinelli, Siyuan Li +8Panoptic SegmentationMetric Depth Estimation

    1ETH Zürich · 2INSAIT, Sofia University · University of Bonn +1

  16. Extending a Large View Synthesis Model for Multi-view Panoptic Segmentation

    Jul 22, 2026Kwonyoung Ryu, In-Jae Lee, Jonghyun Jin +3Panoptic SegmentationMulti-View Learning

    POSTECH · Seoul National University · POSCO DX +1

  17. Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention

    Jul 20, 2026Wenbo Wei, Jun Wang, Shan Raza +1Panoptic SegmentationOcclusion Reasoning

    Department of Computer Science, University of Warwick, Coventry, UK

  18. Text-Aided Multi-Modal Panoptic Symbol Spotting for CAD Floor Plan Drawings

    Jul 14, 2026Yan Gong, Bohao Li, Bowen Du +1Panoptic SegmentationCross-Modal Alignment

    aCCSE Lab, Beihang University, Beijing, 100191, China · bSchool of Transportation Science and Engineering, Beihang University, Beijing, 100191, China · cThe Hong Kong Polytechnic University, Hong Kong, China

  19. HSA: Hierarchical Slot Attention for Multi-granularity Scene-Decomposition

    Jul 9, 2026Neelu Madan, Rongzhen Zhao, Andreas Mogelmose +4Panoptic SegmentationHierarchical Representation Learning

    1Aalborg University, Denmark · 2Pioneer Centre for AI, Denmark · 3Aalto University, Finland +2

  20. Pano3D: Unified 3D Reconstruction and Panoptic Segmentation

    Jun 12, 2026Victor Barberteguy, Ahmet Iscen, Mathilde Caron +3Panoptic Segmentation3D Semantic Segmentation

    Google DeepMind · LIGM, École des Ponts, IP Paris, Univ Gustave Eiffel, CNRS

  21. EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

    Jun 8, 2026Runsong Zhu, Jiaxin Guo, Xiaoyang Guo +9Panoptic SegmentationOpen-Vocabulary 3D Segmentation

    The Chinese University of Hong Kong, HK SAR, China · Hong Kong Centre for Logistics Robotics, HK SAR, China · Horizon Robotics, China +2

  22. Scene-Centric Unsupervised Video Panoptic Segmentation

    Jun 3, 2026Christoph Reich, Oliver Hahn, Nikita Araslanov +4Panoptic SegmentationVideo Object Segmentation

    TU Munich · TU Darmstadt · MCML +3

  23. Redefining Instance Matching: A Unified Framework for Part-Aware Matching in Panoptic Segmentation Evaluation

    May 29, 2026Erik Großkopf, Soumya Snigdha Kundu, Hendrik Möller +9Image SegmentationPanoptic Segmentation

    Hertie Institute for AI in Brain Health, University of Tübingen, Germany · King’s College London, UK · Technical University of Munich, Germany +1

  24. U-SEG: Uncertainty in SEGmentation -- A systematic multi-variable exploration

    May 14, 2026Michael Smith, Frank P. FerrieImage SegmentationPanoptic Segmentation

    Centre for Intelligent Machines, McGill University

  25. MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation

    May 12, 2026Qing Cheng, Damiano Bertolini, Wei Zhang +3Image SegmentationPanoptic Segmentation

    Technical University of Munich · Munich Center for Machine Learning (MCML) · Polytechnic University of Milan +3

  26. FuTCR: Future-Targeted Contrast and Repulsion for Continual Panoptic Segmentation

    May 12, 2026Nicholas Ikechukwu, Keanu Nichols, Deepti Ghadiyaram +1Contrastive LearningImage Segmentation

    Boston University

  27. Hyp2Former: Hierarchy-Aware Hyperbolic Embeddings for Open-Set Panoptic Segmentation

    May 4, 2026Yao Lu, Rohit Mohan, Florian Drews +2Image SegmentationPanoptic Segmentation

    Department of Computer Science, University of Freiburg, Germany · Bosch Research, Robert Bosch GmbH, Germany

  28. Adverse-to-the-eXtreme Panoptic Segmentation: URVIS 2026 Study and Benchmark

    Apr 18, 2026Yiting Wang, Nolwenn Peyratout, Tim Brodermann +13Image SegmentationPanoptic Segmentation

    Organizers of the URVIS 2026 Challenge

  29. Ψ-Map: Panoptic Surface Integrated Mapping Enables Real2Sim Transfer

    Apr 13, 2026Xuan Yu, Yuxuan Xie, Changjian Jiang +43D ReconstructionRobotic Perception

    Department of Control Science and Engineering, Zhejiang University, Hangzhou, Zhejiang, P. R. China

  30. Fast-SegSim: Real-Time Open-Vocabulary Segmentation for Robotics in Simulation

    Apr 13, 2026Xuan Yu, Yuxuan Xie, Shichao Zhai +3Open-Vocabulary 3D SegmentationPanoptic Segmentation

    Department of Control Science and Engineering, Zhejiang University, Hangzhou, Zhejiang, P. R. China