stat.MLSep 22, 2026

Scalable Minimum-Volume Simplex Estimation with Non-asymptotic Analysis

Authors: Jun LIYanlong GuoZhaozhao Zeng

Abstract

We study the estimation of a KK-dimensional simplex from NN i.i.d.\ points sampled uniformly from its interior; the observations are convex combinations of K+1K+1 unknown prototypes. Existing polynomial-time estimators need cubic per-sample work or O(NK)O(NK) storage and are impractical at N106N\sim 10^6--10810^8. We propose DeepMVSA, which re-expresses the minimum-volume principle in neural implicit form: a lightweight coordinate network generates the mixing weights and a triangular LU-type parameterization the dual simplex matrix, reducing the trainable-state memory to O(K2)O(K^2), independent of NN, and the cost per data pass to O(NK2)O(NK^2). We prove a non-asymptotic sample-complexity bound of the polynomial-time benchmark order for a localized surrogate estimator; an oracle inequality for every global minimizer of the neural objective, with volume-inflation control and an explicit shrinkage bias; a conditional end-to-end error budget separating statistical, approximation, optimization, and enclosure-residual terms on an explicit envelope event; and two-point lower bounds: at any noise level σ>0σ>0 fixed independently of NN, the N1/2N^{-1/2} scaling is unimprovable in its NN-exponent. Experiments with up to N=108N=10^8 synthetic observations are consistent with the predicted accuracy and scaling, and feasibility on real scenes of 107\sim 10^7 pixels is demonstrated.

Explore similar work

Jun 22, 2026cs.LG

Exact Schur-Sylvester Dimensionality Reductions for Non-Smooth Stochastic Complexity and Manifold Sampling

The exact computation of the Normalized Maximum Likelihood (NML) codelength for regular non-smooth estimators (e.g., Lasso) has been historically limited by the cubic scaling walls of manifold-constrained projection and volume integration. At each step of the geometric Propose-and-Project Metropolis--Hastings (PPMH) sampler, evaluating the projection operator requires inverting an (N+k)×(N+k)(N+k) \times (N+k) generalized KKT matrix, while calculating the volume factor requires the determinant of an (Nk)×(Nk)(N-k) \times (N-k) Gram matrix. This paper presents an exact, mathematically equivalent formulation that bypasses both bottlenecks by utilizing the block Schur complement and Sylvester's determinant identity. We prove that the computational complexity of both operations collapses from O(N3)\mathcal{O}(N^3) to O(k3+N2k)\mathcal{O}(k^3 + N^2 k) per step. We generalize this reduction to Sparse Support Vector Machines (SVMs), Elastic Net, and Group Lasso. Finally, we provide a rigorous numerical stability analysis and evaluate the sampler's efficiency using the Effective Sample Size (ESS) per second. Our empirical benchmarks on high-dimensional datasets confirm a constant speedup exceeding 14,100×14{,}100\times while maintaining double-precision numerical equivalence, rendering exact non-smooth NML estimation highly tractable for large-scale statistical inference.
Trenton Lau, Gary P. T. Choi
Jul 4, 2026cs.CV

DS-SAC: Density Search for Sample Consensus

Robust geometric model estimation is a fundamental problem in computer vision. RANSAC and its variants remain widely used for this task; however, they rely on stochastic minimal sampling. In this article, we propose Density Search Sample Consensus (DS-SAC), a deterministic robust estimation framework, that avoids repeated random sampling by searching dense regions. Starting from an initial model estimated from the available points, the method performs local exploration via forward and backward search. To facilitate global exploration, DS-SAC recursively partitions the point set using signed residuals and searches each valid partition for high-consensus models. We show that DS-SAC has polynomial complexity with respect to the number of points, making it an efficient alternative to stochastic consensus-based methods. Experiments on large-scale real-world datasets for homography, fundamental matrix, and essential matrix estimation show that DS-SAC achieves higher AUC scores, competitive or lower median pose errors, and faster runtime compared with widely used robust estimators, including RANSAC, MAGSAC, LO-RANSAC, and GC-RANSAC.
Suraj Thapa, Muhammad Aminul Islam
Apr 24, 2026cs.CV

Non-Minimal Sampling and Consensus for Prohibitively Large Datasets

We introduce NONSAC (Non-Minimal Sampling and Consensus), a general framework for robust and scalable model estimation from arbitrarily large datasets contaminated with noise and outliers. NONSAC repeatedly samples non-minimal subsets of data and generates model hypotheses using a robust estimator, producing multiple candidate models. The final model is selected based on a predefined scoring rule that evaluates hypothesis quality. Our framework is estimator-agnostic and can be integrated with existing geometric fitting algorithms such as RANSAC to improve both scalability and robustness to outliers. We propose and evaluate various scoring rules for NONSAC on relative camera pose estimation, Perspective-n-Point, and point cloud registration. Furthermore, we showcase the applicability of NONSAC to correspondence-free point cloud registration by hypothesizing all-to-all correspondences.
Seong Hun Lee, Patrick Vandewalle, Javier Civera