Scene Graph Generation

Also known as SGG

Overview

Scene graph generation identifies objects in images or videos and connects them with relationships, creating explicit representations that can support visual question answering, activity analysis, and robot planning. Common approaches combine object detectors with relation classifiers, graph neural networks, or transformers; newer work uses vision-language models, open-vocabulary learning, and diffusion to handle unfamiliar categories and structured outputs. The field spans image benchmarks such as Visual Genome, video datasets such as Action Genome, and 3D settings such as 3DSSG, with growing attention to temporal relations and embodied tasks. A central challenge is producing precise, useful relations despite long-tailed categories and incomplete annotations, while maintaining robust generalization and efficient inference.

Latest papers

CardsList

49 papers6 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

  1. ChartGalaxy++: A Richly Annotated Dataset for Chart Understanding and Generation

    Nov 11, 2026Duan Li, Zheng Wang, Jiangning Zhu +2Chart UnderstandingData Visualization

  2. PSGAgent: Enhancing MLLMs' Dynamic Visual Perception for Panoptic Scene Graph Generation via Agentic Reasoning

    Nov 5, 2026Qingyun Liu, Yuankun Liu, Jiaye Feng +6Scene Graph GenerationTool-Using Vision-Language Agents

  3. Coupled Scene Graph Anticipation: When With-Constraint Recall Hides Structural Inconsistency

    Nov 4, 2026Zeno Nongmaithem, Anushttha Srivastava, Anshit Sinha +4Video SGGScene Graph Generation

  4. Understanding Backdoor Attacks in Scene Graph Generation via Global Context Pathway

    Nov 3, 2026Xiaoguang Chang, Tuo Chen, Chengze Jiang +2Scene Graph Generation

  5. T-ConSG: A LiDAR-Based Real-Time Temporal Construction Scene Graph for Dynamic and Evolving Environments

    Oct 25, 2026Yilong Chen, Yong K. Cho3D SGGScene Graph Generation

  6. Spherical Geometry-Aware Panoptic Scene Graph Generation for Equirectangular Panoramas

    Oct 20, 2026Zhe Wu, Xiaoyan Fei, Xinyi Jiang +4Scene Graph GenerationPanoptic Segmentation

  7. Geometry-Informed Distributed Acoustic Scene Understanding

    Sep 7, 2026Yiyuan Yang, Shitong Xu, Niki Trigoni +1Scene Graph GenerationAudio Understanding

  8. G3Ego: Gaze-Guided Graphs for Egocentric Action Understanding

    Aug 20, 2026Marko Haralović, Akash Ramakrishnan, Estefania Talavera MartinezEgocentric Video UnderstandingVideo Action Recognition

  9. Sterilizable Scene Graph Generation for Operating Rooms

    Aug 17, 2026Nick Lemke, Ssharvien Kumar Sivakumar, Antoine P. Sanner +4Scene Graph GenerationSurgical Video Understanding

  10. SAGE-OR: Semi-supervised Adaptive Scene Graph Generation for Operating Rooms

    Aug 15, 2026Brandon Leblanc, Charalambos PoullisScene Graph Generation3D Scene Understanding

  11. OvDSGG: End-to-End Open-Vocabulary Dynamic Scene Graph Generation

    Aug 14, 2026John Helsby, Yi Yang, Bodo Rosenhahn +1Scene Graph GenerationVideo SGG

  12. Modeling Scientific Experiment Scenes: Dataset and Model

    Aug 3, 2026Minghao Zou, Qingtian Zeng, Shangkun Liu +5Scene Graph Generation

  13. Geometric 2D Scene Graph Generation

    Jul 24, 2026Christoph Jahn, Urs Waldmann, Bastian GoldlueckeScene Graph GenerationGraph Representation Learning

  14. T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video

    Jul 23, 2026Linlin Wang, Xue Yang, Zhihuang Zhou +3Video UnderstandingScene Graph Generation

  15. Revisiting Scene Graph Generation from the Perspective of Detector-Conditioned Reachability

    Jul 7, 2026Runfeng Qu, Pia K Bideau, Ole Hall +3Scene Graph Generation

  16. VisTCP: A Visualization Framework to Construct Knowledge-Graph-Based Representation for Traditional Chinese Painting

    Jul 7, 2026Zhiguang Zhou, Fengling Zheng, Miaoxin Hu +9KG ConstructionScene Graph Generation

  17. Learning to Evolve Scenes: Reasoning about Human Activities with Scene Graphs

    Jul 2, 2026Francesca Pistilli, Simone Alberto Peirone, Giuseppe AvertaScene Graph GenerationEgocentric Video Understanding

  18. DeWorldSG: Depth-Aware 3D Semantic Scene Graph Generation via World-Model Priors

    Jul 1, 2026Seok-Young Kim, Abdelrahman Elskhawy, Taewook Ha +4Scene Graph Generation3D SGG

  19. Modular Diffusion Models for Structured Visual Recognition

    Jun 21, 2026Siddhesh Khandelwal, Björn Ommer, Leonid SigalScene Graph GenerationUncertainty Quantification

  20. PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experiments

    Jun 8, 2026Minghao Zou, Qingtian Zeng, Shangkun Liu +5Scene Graph GenerationVisual Reasoning

  21. EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories

    Jun 6, 2026Hassan Jaber, Refinath S N, Luca Cagliero +2Visually Grounded ReasoningVisual Spatial Reasoning

  22. Visual Commonsense Driven Knowledge Refinements for Scene Graph Generation

    Jun 4, 2026Maëlic Neau, Salim Baloch, Jakob Suchan +2Scene Graph GenerationCommonsense Reasoning

  23. QPredSGG: Hybrid Quantum Predicate Learning for Long-Tailed Scene Graph Generation

    Jun 3, 2026Prerana Ramkumar, Nouhaila Innan, Muhammad ShafiqueScene Graph GenerationLong-Tailed Classification

  24. Seeing Fast and Slow: Bimodal 3D Scene Graphs for Open-set Tasks

    May 29, 2026Marcel Bartholomeus Prasetyo, Shrutika Vishal Thengane, A Manicka Praveen +2Scene Graph Generation3D SGG

  25. Learning Context-Conditioned Predicate Semantics via Prototype Feedback

    May 28, 2026NamGyu Jung, Chang ChoiScene Graph GenerationPrototype Learning

  26. FOUND-IT: Foundation-model-first Task-driven 3D Scene Graphs with Granularity on Demand

    May 25, 2026Dominic Maggio, Nicolas Gorlo, Kris Hauser +13D Foundation ModelsScene Graph Generation

  27. RGB-only Active 3D Scene Graph Generation for Indoor Mobile Robots

    May 18, 2026Giorgia Modi, Davide Buoso, Giuseppe Averta +1Active PerceptionScene Graph Generation

  28. SceneGraphVLM: Dynamic Scene Graph Generation from Video with Vision-Language Models

    May 13, 2026Vladislav Makarov, Mark Gizetdinov, Dmitry YudinScene Graph GenerationVision-Language Models

  29. BARISTA: A Multi-Task Egocentric Benchmark for Compositional Visual Understanding

    May 12, 2026Patrick Knab, Orgest Xhelili, Inis Buzi +7Video UnderstandingScene Graph Generation