A Unified Variational Framework for Deep Weakly Supervised Image Segmentation
Authors: Yin King Chu, Lingfeng Li, Sung Ha Kang, Jianping Zhang, Xue-Cheng Tai
Organizations: Department of Mathematics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China · Hetao Institute of Mathematics and Interdisciplinary Sciences, Shenzhen, Guangdong, China · School of Mathematics, Georgia Institute of Technology, Atlanta, GA, 30332, USA · School of Mathematics and Computational Science, Xiangtan University, Xiangtan, Hunan, 411105, P.R. China · Norwegian Research Center, Fantoftveien 38, 5072, Bergen, Norway
We propose a unified variational framework for image segmentation under sparse pixel-level supervision. Our method is based on a simplex-constrained Potts model with a smooth perimeter regularizer, yielding a convex, smooth energy functional that can be used as a training loss in weakly supervised deep learning paradigms or optimized efficiently using iterative methods. Sparse labels are incorporated into the data fidelity term by constructing a fuzzy membership function via a function extension problem in a Reproducing Kernel Hilbert Space (RKHS), which can effectively capture inhomogeneous intensity statistics. The derived discrete loss for training standard networks demonstrates robustness and consistent improvements over non-training and partial cross-entropy (PCE) baselines in experiments, achieving comparable performance without requiring ground-truth segmentation images.