math.OCNov 16, 2026

Parallelizable Interior-Point ADMM for Block-Structured Nonconvex Programs

Authors: Zherong Pan

Organizations: Meta Reality Labs

Abstract

Physics simulation is an increasingly important computational primitive for AI, and local--global/ADMM splitting exposes its parallel structure but lacks matching finite-time convergence guarantees. We close this gap with two ADMM variants, Interior-Point ADMM (IP-ADMM), for block-structured nonconvex composite programs with smooth nonlinear inequality and affine constraints. A one-sided finite-activation wall keeps each constraint split state strictly feasible while the original-space infeasibility vanishes, giving closed-form constraint updates, one proximal call per objective block, and one equality-constrained quadratic consensus solve per iteration. \rev{To our knowledge, this makes IP-ADMM the first single-loop method that updates nonconvex inequality constraints locally and in parallel with finite-time convergence guarantees.} Ordinary IP-ADMM attains a CQ-free best-iterate weak-KKT rate of O(K−1/3)O(K^{-1/3}) or a banded Fritz--John rate of O(K−1/4)O(K^{-1/4}), which converts to KKT at O(K−1/4)O(K^{-1/4}) under a uniform constraint qualification; these are nearby-point certificates that reduce to conventional KKT for smooth blocks. A checkpoint variant, IP-ADMM-Ckpt, improves the asymptotic KKT exponent to O(K−1/3)O(K^{-1/3}). We also show how the bounds scale with the objective- and constraint-block counts and the coupling norm.

Explore similar work

CardsList
  1. Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization

    Jun 26, 2026Shuang Li, Zhihui Zhu, Qiuwei LiOptimization Convergence AnalysisDistributed Optimization

  2. AI-Assisted Discovery and Construction of a Counterexample to the Convergence of Three-Block ADMM with the Identity Matrix as its Third Constraint Block

    Aug 14, 2026Kenan Xu, Xiangfeng WangAI-Assisted Mathematical DiscoveryAlternating Direction Method of Multipliers

  3. Learned Preconditioning for a Primal-Dual Interior-Point Method

    Sep 28, 2026Abhinav Madabhushi, Jialin Liu, Minxin ZhangPrimal-Dual OptimizationLearning to Optimize