cs.DSFeb 23, 2026

Exploiting Low-Rank Objective Structure in Discrete Quadratic Optimization

Authors: Ria Stevens, Fangshuo Liao, Barbara Su, Thanasis Hadjidimoulas, Jianqiang Li, Anastasios Kyrillidis

Organizations: Rice University

Abstract

We study the problem of maximizing a complex-valued quadratic form over the KthK^{\text{th}} roots of unity. We show that when the objective matrix Q⋆∈Cn×n\mathbf{Q}^\star \in \mathbb{C}^{n \times n} of the quadratic has rank rr, the global maximizer belongs to a candidate set of size O(rn2r−1)O(rn^{2r-1}). This set can be constructed deterministically in O(rn2r+1)O(rn^{2r+1}) time by enumerating the vertices of a hyperplane arrangement in R2r.\mathbb{R}^{2r}. The algorithm is embarrassingly parallel; with~PP processors, the time complexity drops to O(rn2r+1/P)O(r n^{2r+1}/P). For approximately low-rank settings, where the objective matrix is a noise-perturbed variant of a rank-rr matrix, we prove that applying our framework to a spectral truncation yields a multiplicative (1−O(∥H∥2/δ⋆))(1 - O(\left\|\mathbf{H}\right\|_2 / δ^{\star}))-approximation guarantee, where δ⋆δ^{\star} denotes the eigengap of the underlying rank-rr matrix and H\mathbf{H} represents the perturbation. To scale to high-dimensional problems, we establish a randomized sampling variant. We prove that uniformly sampling S≥O(1/εr−1)S \geq O(1/\varepsilon^{r-1}) candidates achieves a (1−ε)cos⁡2(π/K)(1-\varepsilon)\cos^2(π/ K)-approximation of the optimal rank-rr solution with high probability. Crucially, this sample size is entirely independent of nn, reducing the overall runtime to O(S⋅n2)O(S \cdot n^2). Computational experiments on synthetic benchmarks and large-scale graphs for Max-3-Cut confirm that our algorithms match or exceed semi-definite programming solution quality on structured instances while enabling massive parallelization across heterogeneous hardware and scaling seamlessly to problems where n≥106n \geq 10^6.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

Mar 5, 2026

Compact Lifted Relaxations for Low-Rank Optimization

We develop tractable convex relaxations for rank-constrained quadratic optimization problems over n×mn \times m matrices, a setting for which tractable relaxations are typically only available when the objective or constraints admit spectral structure. We derive lifted semidefinite relaxations that do not require such spectral terms. Although a direct lifting introduces a large semidefinite constraint in dimension n2+nm+1n^2 + nm + 1, we prove that many blocks of the moment matrix are redundant and derive an equivalent compact relaxation that only involves two semidefinite constraints of dimension nm+1nm + 1 and n+mn+m, respectively. We also derive a new class of valid inequalities for low-rank problems, which we call projection cuts, that exploit the fact that rank constraints are inherited by linear images of a low-rank matrix, to strengthen our low-rank relaxations substantially. For matrix completion and reduced-rank regression problems, among others, we exploit additional structure to obtain even more compact formulations involving semidefinite matrices of dimension at most the sum of the two dimensions of the low-rank decision matrix (i.e., of size at most n+mn+m). Overall, we obtain scalable semidefinite bounds for a broad class of low-rank quadratic problems.
Aug 12, 2026

Fast Length-Squared Sampling for Positive-Semidefinite Matrices

We describe a simple rejection-sampling-based algorithm to perform length-squared sampling on an n×nn \times n positive-semidefinite (psd) matrix: that is, to sample a column with probability proportional to its squared ℓ2\ell_2-norm. The algorithm runs in just O(n)O(n) expected time, which is significantly sublinear in the input matrix size. The runtime is optimal, even when the input is assumed to be diagonal. Our result has several applications. Length-squared sampling is used by a number of sublinear time algorithms for matrix problems, like low-rank approximation and eigenvalue approximation. Often, it is assumed that the algorithm is given access to the matrix column norms, and thus can perform length-squared sampling efficiently. Our result shows that, at least for psd matrices, we can remove this assumption. We also discuss an application to an asymptotically optimal algorithm for estimating the Frobenius norm of a psd matrix to relative error. Finally, we show that our sampling algorithm yields a very simple sublinear time algorithm for the robust psd low-rank approximation problem introduced by Bakshi et al. (FOCS, 2020), which nearly matches the more complex method developed there.
Oct 2, 2026

Information Limits of Low-Rank Approximation Certification

Low-rank approximation can require additional matrix--vector products to verify that its error meets a prescribed tolerance. We characterize this certification cost for both relative matrix error and mean-square output error. For a single approximation matrix candidate, we determine the exact dimension-uniform minimax query constant as the allowed failure probability vanishes. Our main result concerns reusing validation responses as the approximation space expands. For a candidate family constructed independently of validation, one batch supports an entire nested path without increasing the query budget with the number of checks. Across WW paths, a concentration bound exploiting shared residual energy yields a log⁡(W+1)\sqrt{\log(W+1)} dependence. A matching lower bound establishes its optimality for fixed interior error targets and sufficiently small separation gaps. Finally, we compare two uniformly valid certificates on the same dispersed-spectrum family. Optimizing the validation budget within each rule family yields costs of orders N1/3N^{1/3} and N2/3N^{2/3} for validation and construction beyond the true target. Code is available at https://anonymous.4open.science/r/Low-rank-approximation-1275/