Authors: Yinjian Wang, Wei Li, Yuanyuan Gui, James E. Fowler, Gemine Vivone
Organizations: School of Information and Electronics, Beijing Institute of Technology, and the National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing, 100081 Beijing, China · Department of Electrical and Computer Engineering, Mississippi State University, Starkville, MS 39762 USA · National Research Council, Institute of Methodologies for Environmental Analysis (CNR-IMAA), 85050 Tito, Italy, and also with National Biodiversity Future Center (NBFC), 90133 Palermo, Italy
Robust principal component analysis (RPCA) seeks a low-rank component and a sparse component from their summation. Yet, in many applications of interest, the sparse foreground actually replaces, or occludes, elements from the low-rank background. To address this mismatch, a new framework is proposed in which the sparse component is identified indirectly through determining its support. This approach, called robust principal component completion (RPCC), is solved via variational Bayesian inference applied to a fully probabilistic Bayesian sparse tensor factorization. Convergence to a hard classifier for the support is shown, thereby eliminating the post-hoc thresholding required of most prior RPCA-driven approaches. Experimental results reveal that the proposed approach delivers near-optimal estimates on synthetic data as well as robust foreground-extraction and anomaly-detection performance on real color video and hyperspectral datasets, respectively. Source implementation and Appendices are available at https://github.com/WongYinJ/BCP-RPCC.
Figures & tables
Fig. 1: Visual comparison of various quantities of the RPCA formulation for an image.
Fig. 2: B-Unfolding: The reorganization of each tensor block into a single column of a matrix.
μin(n)←aˉin(n),Σin(n)←IR,ar←a0,br←b0,
ck←c0,dk←d0,zˉk←z0,α←α0,β←β0
Algorithm 1 The BCP-RPCC Algorithm
Fig. 3: Box plots of RRSE and IoU on synthetic data. RRSE is standardized via Z-score transformation. The statistics in blue in the upper area are the original mean (mn), standard deviation (std) and median (md) of RRSE for each group of 20 runs.
Fig. 4: Example frames, along with ground-truth foreground masks and ROIs, from the four CDnet videos used for the foreground-extraction experiments.
Fig. 5: Hyperparameter tuning for foreground extraction using F1 and IoU . Row 1: Tuning σ when R=25 . Row 2: Tuning R when σ=10−3 .
Fig. 6: Foreground extraction for the Highway dataset. Row 1: Frame 10. Row 2: Frame 25. Row 3: Frame 50.
Fig. 7: Foreground extraction for the Turnpike dataset. Row 1: Frame 10. Row 2: Frame 25. Row 3: Frame 50.
Fig. 8: Foreground extraction for the Crossroad dataset. Row 1: Frame 10. Row 2: Frame 45. Row 3: Frame 50.
Fig. 9: Foreground extraction for the Busstation dataset. Row 1: Frame 1. Row 2: Frame 25. Row 3: Frame 50.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.2395
0.1543
0.0292
KBR
0.3919
0.2862
0.0060
TRPCA
0.3905
0.2779
0.0138
ETRPCA
0.3607
0.2498
0.0197
t-CTV
0.3470
0.2310
0.0455
TABLE I: Foreground Extraction for Highway. Best results are in boldface.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.2501
0.1527
0.0713
KBR
0.2466
0.1561
0.0394
TRPCA
0.2791
0.1765
0.0591
ETRPCA
0.2758
0.1736
0.0648
t-CTV
0.2253
0.1389
0.0706
TABLE II: Foreground Extraction for Turnpike. Best results are in boldface.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.2202
0.1361
0.0412
KBR
0.2319
0.1554
0.0095
TRPCA
0.2854
0.1949
0.0214
ETRPCA
0.2657
0.1752
0.0328
t -CTV
0.2807
0.1870
0.0510
TABLE III: Foreground Extraction for Crossroad. Best results are in boldface.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.1658
0.1013
0.0631
KBR
0.2105
0.1404
0.0124
TRPCA
0.2031
0.1335
0.0265
ETRPCA
0.1923
0.1229
0.0391
t-CTV
0.1461
0.0874
0.0925
TABLE IV: Foreground Extraction for Crossroad. Best results are in boldface.
Fig. 10: Foreground-extraction performance in terms of F1(τ) , IoU(τ) , and Fa(τ) : Highway (row 1), Turnpike (row 2), Crossroad (row 3), and Busstation (row 4).
Fig. 11: Hyperspectral datasets for anomaly detection; second row is ground truth.
Fig. 12: Hyperparameter tuning for hyperspectral anomaly detection. Row 1: Tuning σ when R=25 . Row 2: Tuning R when σ=4×10−3 for Belcher and Beach, σ=9×10−3 for Urban and σ=3×10−2 for Salinas.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.1717
0.0992
0.0101
KBR
0.2135
0.1297
0.0088
TRPCA
0.2084
0.1218
0.0329
LRTFR
0.2785
0.1751
0.0167
PTA
0.0921
0.0490
0.1093
TABLE V: Anomaly Detection for Belcher. Best results are in boldface.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.1656
0.0931
0.1365
KBR
0.2672
0.1715
0.1052
TRPCA
0.2987
0.1956
0.1504
LRTFR
0.2354
0.1453
0.1058
PTA
0.1403
0.0792
0.3321
TABLE VI: Anomaly Detection for Urban. Best results are in boldface.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.0960
0.0520
0.0030
KBR
0.1391
0.0770
0.0284
TRPCA
0.1285
0.0714
0.0411
LRTFR
0.2469
0.1552
0.0275
PTA
0.0703
0.0378
0.1100
TABLE VII: Anomaly Detection for Beach. Best results are in boldface.
Methods
Metrics
AUCF1↑
AUCIoU↑
AUCFa↓
PCP
0.4369
0.3056
0.0090
KBR
0.5613
0.4311
0.0221
TRPCA
0.4733
0.3537
0.0583
LRTFR
0.5533
0.4317
0.0222
PTA
0.2946
0.2094
0.2352
TABLE VIII: Anomaly Detection for Salinas. Best results are in boldface.
Fig. 13: Anomaly detection on Belcher (row 1), Urban (row 2), Beach (row 3), and Salinas (row 4).
Fig. 14: Anomaly-detection performance in terms of F1(τ) , IoU(τ) and Fa(τ) : Belcher (row 1), Urban (row 2), Beach (row 3) and Salinas (row 4).
Principal component analysis (PCA) finds orthogonal directions of greatest variance for data compression, visualization, denoising, and feature discovery.
Robust tensor completion recovers multidimensional data from partial observations corrupted by sparse gross errors. Existing convolutional low-rank models typically construct translated copies using circular continuation, which introduces artificial wrap-around neighborhoods for finite nonperiodic data. We propose reflective convolution nuclear norm minimization (RCNNM), which replaces circular shifts with endpoint-nonrepeating reflection. The resulting lifting has nonuniform entry multiplicities and satisfies a weighted Gram identity that supports both the recovery analysis and the optimization method. Under random sampling and sparse corruption, we establish high-probability exact recovery of the underlying tensor and sparse errors, together with stability under bounded dense perturbations. We further develop a two-block ADMM with a closed-form entrywise tensor update, while singular-value thresholding is implemented through the smaller right Gram matrix. Experiments on synthetic tensors, BSDS color images, and CAVE multispectral images show that RCNNM consistently improves over its circular-lifting counterpart, with the clearest gains near image boundaries. In particular, average boundary-PSNR improvements reach 3.26 dB while global reconstruction quality remains competitive.
Weiguo Zhou, Feng Zhang, Wenjin Qin +1
School of Mathematics and Statistics, Southwest University, Chongqing, 400715, China · College of Artificial Intelligence and Advanced Interdisciplinary Sciences, Chongqing Normal University, Chongqing, 401331, China
Low-rank tensor factorization provides a flexible framework for completing multidimensional data from incomplete and corrupted observations. However, unweighted spectral regularizers impose a common shrinkage profile across singular components, which may excessively attenuate dominant low-rank components, and factorized variants either lack component-specific weighting or require costly singular value decompositions (SVDs). This paper proposes two weighted Schatten-p tensor factorization models, termed \WSpTFI{} and \WSpTFII{}, under the tensor-tensor product (t-product) framework to address these limitations. \WSpTFI{} is motivated by a factorized weighted tensor Schatten-p norm identity and permits flexible, possibly asymmetric factor exponents. \WSpTFII{} constructs a regularizer from transform-domain column-pair energies, yielding SVD-free main factor updates and a column-pruning mechanism for reducing redundant rank components. This paper further develops an iteratively reweighted alternating direction method of multipliers (ADMM)-type scheme for \WSpTFI{} and an iteratively reweighted least squares (IRLS)--block successive upper-bound minimization (BSUM) scheme for \WSpTFII{}. Theoretical analysis establishes the weighted factorization relation and provides a conditional limiting Karush--Kuhn--Tucker (KKT) characterization for \WSpTFI{}. For \WSpTFII{}, the actual damped quadratic block updates yield a quantitative sufficient-decrease mechanism for the fixed-δ smoothed factor objective. This implies asymptotic regularity, and every accumulation point of the fixed-dimensional tail is stationary. Experiments on synthetic tensor completion, color-image restoration, hyperspectral inpainting, and printed-circuit-board defect detection demonstrate competitive reconstruction quality and robustness under various degradation conditions.
Binghao Wang, Feng Zhang, Wendong Wang +1
School of Mathematics and Statistics, Southwest University, Chongqing 400715, China · College of Artificial Intelligence, Southwest University, Chongqing 400715, China
While principal component analysis (PCA) is a fundamental tool for dimensionality reduction, its dense representations make it ill-suited for high-dimensional data. Existing methods address this by promoting sparsity through explicit ℓ1-penalties, but these are not obvious to tune due to the unsupervised nature of the task. In contrast, we propose Adversarial PCA (AdvPCA), which leverages robust optimization to achieve sparsity by optimizing the reconstruction objective against bounded, worst-case latent space perturbations. We show that this formulation admits a closed-form reduction, leading to a practical iterative algorithm that alternates between adversarial linear regression-style updates for the sparse encoder and orthogonal updates for the decoder. By theoretically characterizing the solution, we derive a data-adaptive parameterization that allows the algorithm to perform effectively out of the box. We validate these claims through numerical experiments on synthetic and real-world genomics data.
David Vävinggren, Francis Bach, André M. H. Teixeira +2
Uppsala University, Sweden · PSL Research University / INRIA, France · Science for Life Laboratory, Sweden