Demixing Sparse Signals from Nonlinear Observations using Generalized Non-convex Regularization
Abstract
We consider the recovery of a pair of sparse vectors from a limited number of nonlinear observations of their superposition: , , with , incoherent orthonormal bases , a scalar link , and noise that may be heavy-tailed or contaminated. We propose a regularization-based framework combining a Huberized data fidelity with generalized folded-concave penalties (SCAD, MCP), and a two-block proximal alternating algorithm with backtracking (NLD-PALM) whose whole iterate sequence provably converges to critical points under the Kurdyka--Łojasiewicz property, with local linear rates. On the statistical side we establish restricted strong convexity of the Huberized nonlinear loss through an exact sign-definite decomposition, and derive estimation error bounds of order that hold at \emph{every} localized stationary point, an oracle rate free of and shrinkage bias under a beta-min condition, and a co-equal recovery theorem for \emph{unknown} monotone links via a linear surrogate and a clipped Plan--Vershynin decoupling. The estimator requires no knowledge of the sparsity levels, and its guarantees hold under symmetric noise with only finite variance. Experiments at under a frozen data-driven regularization rule show an earlier phase transition than convex demixing and greedy hard-thresholding baselines, a accuracy advantage over squared-loss estimation under gross outliers, and successful demixing of spike-plus-background signals observed through a saturating amplifier.
Explore similar work
Separating Oblivious and Adaptive Models of Variable Selection
for each'') and \emph{adaptive} (for all'') models of sparse recovery. We show that under an oblivious model, the optimal error is attainable in near-linear time with samples, whereas in an adaptive model, samples are necessary for any algorithm to achieve this bound. This establishes a surprising contrast with the standard setting, where samples suffice even for adaptive sparse recovery. We conclude with a preliminary examination of a \emph{partially-adaptive} model, where we show nontrivial variable selection guarantees are possible with measurements.