WeatherSeg: Weather-Robust Image Segmentation using Teacher-Student Dual Learning and Classifier-Updating Attention
Organizations: School of Artificial Intelligence and Information Engineering, Zhejiang University of Science and Technology, Hangzhou, China · Department of Computer and Information Sciences, Northumbria University, Newcastle, United Kingdom · Beijing Quinovare Medical Technology Co., Ltd, Beijing, China · School of Artificial Intelligence, Shenzhen University, Shenzhen, China
Abstract
WeatherSeg, an advanced semi-supervised segmentation framework, addresses autonomous driving's environmental perception challenges in adverse weather while reducing annotation costs. This framework integrates a Dual Teacher-Student Weight-Sharing Model (DTSWSM) that enables knowledge distillation from weather-affected images, and a Classifier Weight Updating Attention Mechanism (CWUAM) that dynamically adjusts classifier weights based on environmental attributes. Comprehensive evaluations demonstrate that WeatherSeg significantly outperforms baseline models in both accuracy and robustness across various weather conditions, including clear, rainy, cloudy, and foggy scenarios, establishing it as an effective solution for all-weather semantic segmentation in autonomous driving and related applications.