Overview

Panoptic segmentation combines semantic segmentation of background-like regions (“stuff”) with instance segmentation of countable objects (“things”), giving a unified account of a scene. Common approaches use query-based transformer decoders, unified-kernel models, and temporal or geometric association, with extensions to open-vocabulary recognition, 3D point clouds, video, and multi-view scenes. Methods are commonly evaluated with Panoptic Quality on benchmarks such as COCO, Cityscapes, and ScanNet, while video and driving settings also test temporal consistency and robustness to adverse conditions. A central challenge is maintaining accurate, consistent instance identities while recognizing unfamiliar objects and meeting the efficiency and annotation constraints of real-world deployment.

Latest papers

CardsList

40 papers5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

  1. Radar Panoptic Transformer: Semantic-Guided Mask Queries for Dynamic Scene Understanding

    Nov 15, 2026Mayank Mayank, Bharanidhar Duraisamy, Rohit Mohan +1Panoptic Segmentation3D Point Cloud Segmentation

  2. WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark

    Nov 4, 2026Rohit Mohan, Maximilian Luz, Swarnava Chowdhury +7Visual Object TrackingAutonomous Driving Benchmarks

  3. Spherical Geometry-Aware Panoptic Scene Graph Generation for Equirectangular Panoramas

    Oct 20, 2026Zhe Wu, Xiaoyan Fei, Xinyi Jiang +4Scene Graph GenerationPanoptic Segmentation

  4. PanoGraphGS: Unifying Panoptic Segmentation and Hierarchical 3D Scene Graphs with Gaussian Splatting

    Oct 20, 2026Jinghan Gao, Siyu Wang, Dongyu Feng +23D SGG3D Scene Understanding

  5. Real-Time Radar Semantic and Panoptic Scene Understanding

    Oct 19, 2026Santosh Parit, Julia Hindel, Rohit Mohan +4Autonomous Driving PerceptionPanoptic Segmentation

  6. Every View Counts: View-Consistent Panoptic Quality for Multi-view Panoptic Segmentation

    Oct 5, 2026Youngmin Lee, Byungha Ko, Guhnoo Yun +1Multi-View ConsistencyPanoptic Segmentation

  7. MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation

    Sep 30, 2026Ivan Martinović, Josip Šarić, Yuki M. Asano +1Panoptic SegmentationUnsupervised Domain Adaptation

  8. ProGuT: Label-Efficient Panoptic Segmentation for Forest Scenes

    Sep 29, 2026Pankaj Deoli, Karsten BernsImage SegmentationPanoptic Segmentation

  9. PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

    Sep 16, 2026Sara Pieri, Evangelos Kazakos, Shizhe Chen +2Image CaptioningPanoptic Segmentation

  10. CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

    Sep 11, 2026Jonathan Sauder, Thomas Ruckli, Gabrielė Strodomskytė +17Panoptic SegmentationInstance Segmentation

  11. PolarSym: Polar Geometry-aware Attention for CAD Floorplan Parsing

    Aug 12, 2026Kerui Chen, Yiqing Wang, Kangzhou Xin +2Panoptic SegmentationTransformer Attention

  12. Learning from Multimodal Pseudo-Labels for Robust Open-Vocabulary Instance and Panoptic Segmentation

    Aug 12, 2026Duy Tran Thanh, Yeejin Lee, Byeongkeun KangPanoptic SegmentationInstance Segmentation

  13. iFAN: Inference-Aware Learning for Plain Mask Transformers

    Aug 4, 2026Fang Li, Yu He, Haoyang Tong +7Panoptic SegmentationInstance Segmentation

  14. DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving

    Jul 28, 2026Yung-Hsu Yang, Luigi Piccinelli, Siyuan Li +8Panoptic SegmentationMetric Depth Estimation

  15. Extending a Large View Synthesis Model for Multi-view Panoptic Segmentation

    Jul 22, 2026Kwonyoung Ryu, In-Jae Lee, Jonghyun Jin +3Panoptic SegmentationMulti-View Learning

  16. Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention

    Jul 20, 2026Wenbo Wei, Jun Wang, Shan Raza +1Panoptic SegmentationOcclusion Reasoning

  17. Text-Aided Multi-Modal Panoptic Symbol Spotting for CAD Floor Plan Drawings

    Jul 14, 2026Yan Gong, Bohao Li, Bowen Du +1Panoptic SegmentationCross-Modal Alignment

  18. HSA: Hierarchical Slot Attention for Multi-granularity Scene-Decomposition

    Jul 9, 2026Neelu Madan, Rongzhen Zhao, Andreas Mogelmose +4Panoptic SegmentationHierarchical Representation Learning

  19. Pano3D: Unified 3D Reconstruction and Panoptic Segmentation

    Jun 12, 2026Victor Barberteguy, Ahmet Iscen, Mathilde Caron +3Panoptic Segmentation3D Semantic Segmentation

  20. EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

    Jun 8, 2026Runsong Zhu, Jiaxin Guo, Xiaoyang Guo +9Panoptic SegmentationOpen-Vocabulary 3D Segmentation

  21. Scene-Centric Unsupervised Video Panoptic Segmentation

    Jun 3, 2026Christoph Reich, Oliver Hahn, Nikita Araslanov +4Panoptic SegmentationVideo Object Segmentation

  22. Redefining Instance Matching: A Unified Framework for Part-Aware Matching in Panoptic Segmentation Evaluation

    May 29, 2026Erik Großkopf, Soumya Snigdha Kundu, Hendrik Möller +9Image SegmentationPanoptic Segmentation

  23. U-SEG: Uncertainty in SEGmentation -- A systematic multi-variable exploration

    May 14, 2026Michael Smith, Frank P. FerrieImage SegmentationPanoptic Segmentation

  24. MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation

    May 12, 2026Qing Cheng, Damiano Bertolini, Wei Zhang +3Image SegmentationPanoptic Segmentation

  25. FuTCR: Future-Targeted Contrast and Repulsion for Continual Panoptic Segmentation

    May 12, 2026Nicholas Ikechukwu, Keanu Nichols, Deepti Ghadiyaram +1Contrastive LearningImage Segmentation

  26. Hyp2Former: Hierarchy-Aware Hyperbolic Embeddings for Open-Set Panoptic Segmentation

    May 4, 2026Yao Lu, Rohit Mohan, Florian Drews +2Image SegmentationPanoptic Segmentation

  27. Adverse-to-the-eXtreme Panoptic Segmentation: URVIS 2026 Study and Benchmark

    Apr 18, 2026Yiting Wang, Nolwenn Peyratout, Tim Brodermann +13Image SegmentationPanoptic Segmentation