cs.CVNov 16, 2026

MVSTF: Multi-View Spatio-Temporal Fusion for LiDAR-Based Moving Object Segmentation

Authors: Jiaoju Zhou, Chao Ye, Xuebo Yang, Weiyang Lin

Organizations: Research Institute of Intelligent Control and Systems, Harbin Institute of Technology, Harbin 150001, China.

Abstract

Autonomous mobile robots confront significant chal lenges in recognizing the motion properties of objects in dy namic environments. However, existing methods are hindered by limitations such as boundary ambiguity, occlusion, viewpoint constraints, and training complexity. In this paper, we propose an innovative end-to-end Multi-View Spatio-Temporal Fusion network, named MVSTF, which utilizes sequential point clouds to generate multi-view images and feature differences, and designs a multi-branch network to extract spatio-temporal and dimen sional features in parallel, and realizes high-precision moving object segmentation. First, sequential point clouds are utilized to generate multi-view images and feature differences. Then, an end-to-end multi-branch network including Dual Down-sampling Blocks (DDB), Spatial Attention Blocks (SAB), Multi-Kernel Convolutional Neural Network blocks (MKCNN), Dual Feature Fusion Blocks (DFFB), and the Point Fusion (PF) module, is designed to extract motion features from feature differences and geometric and semantic features from multi-view images. Finally, an auxiliary semantic head is introduced to further improve the algorithm's robustness and the model's interpretability. This work is validated on the SemanticKITTI and KITTI-Road bench marks, achieving state-of-the-art results on the SemanticKITTI MOS validation set and the KITTI-Road validation set, and competitive results on the hidden SemanticKITTI-MOS test set. The code is available at https://github.com/ZhouJJ111/MVSTF.

Figures & tables

Explore similar work

CardsList
  1. HiPFuse: Real-Time LiDAR Semantic Segmentation for Robotic Perception on Edge Devices

    Nov 10, 2026Haiyang Wu, George Vosselman, Ville Lehtola3D Semantic Segmentation3D Point Cloud Segmentation

  2. CLFTv2: Efficient Camera-LiDAR Fusion for Semantic Segmentation via Hierarchical Feature Pyramids

    Sep 9, 2026Toomas Tahves, Mauro Bellone, Raivo SellCamera-LiDAR FusionAutonomous Driving Perception

  3. LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation

    May 20, 2026Daojie Peng, Bingtao Wang, Fulong Ma +2Edge InferenceCamera-LiDAR Fusion