Solver Iterations

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21

Latest papers 46

All topics

The Advantages of Fresh Sketching for Ridge Regression
Sep 29, 2026Linkai Ma, Qilin Li, Petros DrineasKernel Ridge Regression Sketches
Purdue University · University of Wisconsin-Madison
GPUPhysBench: Benchmarking Coding Agents for Correct and Efficient GPU Physics Simulation
Sep 28, 2026Yuchen Sun, Jinjin He, Sinan Wang +1Physics Simulation Coding Agents
Georgia Institute of Technology
JIVE: Jacobian-Informed Volume Expansion for Diverse Generative Sampling
Sep 27, 2026Guangxun Zhang, Brian Cai, Boxuan Zhang +2Diversity Jacobian
New York University · Stony Brook University · Rutgers University
lapanda: A Matrix-Free Differentiable Solver for Nonconvex Constrained Optimization Layers
Sep 27, 2026Yuankun Chen, Zifei Nie, Kangyu Lin +2Differentiable Optimization Convex Optimization
School of Artificial Intelligence, Jilin University, China · Graduate School of Informatics, Kyoto University, JPN · Department of Civil and Systems Engineering, Johns Hopkins University, USA
Repairability of Inexact Solvers in Recursive State Estimation with Machine Learning
Sep 23, 2026Yanjun Ji, Dennis Willsch, Orkun Şensebat +8State Estimation Solver Iterations
Jülich Supercomputing Centre, Forschungszentrum Jülich, 52425 Jülich, Germany · FH Aachen University of Applied Sciences, 52066 Aachen, Germany · Institute for Automation of Complex Power Systems, RWTH Aachen University, Aachen, Germany +5
Probabilistic and Geometry Aware Neural Surrogate of Scrape Off Layer Plasma Simulations
Sep 23, 2026Gabriele Gianuzzo, Stefan Dasbach, Fleur Hendriks +2Surrogate Models Surrogates
Eindhoven University of Technology · DIFFER
SPARSER: Sparse Variable Projection by Exploiting Separable Structure in Robotic Perception
Sep 21, 2026Nikolas R. Sanderson, Andrew Fishberg, Haoyu Han +5Robotic Perception Simultaneous Localization And Mapping
Department of Naval Architecture and Marine Engineering, University of Michigan, Ann Arbor, MI, USA · Institute of Experiential Robotics, Northeastern University, Boston, MA, USA · Aerospace Controls Lab, Massachusetts Institute of Technology, Cambridge, MA, USA +1
PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers
Sep 17, 2026Jiachen Yao, Zi-Siang Hsu, Xi Deng +5Bayesian Inverse Problems Posterior Sampling
California Institute of Technology · National Taiwan University · Lawrence Berkeley National Laboratory +3
Time Without Timesteps: Simulating Coupled Dynamical Systems via Self-Consistency
Sep 3, 2026Liyu Zerihun, Mark Shinyoung LeeDynamical Systems Slow Relaxation Modes
DEFT: Data-Efficient Frequency-domain Top-k Sampling via Inverse Discrete Fourier Transform for Spatiotemporal Dynamical Systems Modeling
Aug 11, 2026Hengbo Xiao, Jiale Liu, Jiahao Song +1Frequency Domain Partial Differential Equations
Peking University
Rake-Compress Riccati Recursions for Parallel Scenario-Tree Model Predictive Control
Aug 2, 2026João Sousa-PintoModel Predictive Control Linear Quadratic Regulator
independent researcher
Graph Neural Multilevel Preconditioners for Iterative Solvers
Jul 30, 2026Zechen Zhang, Rui Peng Li, Yousef SaadAlgebraic Multigrid Spectral Preconditioning
University of Minnesota Minneapolis, MN, USA · CASA, Lawrence Livermore National Laboratory Livermore, CA, USA
Amortising Trajectory Optimisation for Residual MPC via Implicit Contact Differentiation
Jul 27, 2026Daniel Layeghi, Thomas Corbères, Calum Arnott +4Robust Trajectory Implicit Differentiation
School of Informatics, University of Edinburgh, Scotland.
Complexity Bounds and Approaches to Learning Projected Gradient Descent Solver Iterates
Jul 24, 2026Anjian Li, Ryne BeesonGradient Descent Solver Iterations
Department of Electrical and Computer Engineering Princeton University, Princeton, NJ 08544, USA · Department of Mechanical and Aerospace Engineering Princeton University, Princeton, NJ 08544, USA
Cycle-Consistent and Uncertainty-Aware Neural Surrogates for Tokamak Edge Plasmas
Jul 23, 2026Abdourahmane Diaw, Sebastian De Pascuale, Jae-Sun Park +3Surrogate Models Nuclear Fusion
Fusion Energy Division, Oak Ridge National Laboratory, Oak Ridge, TN 37932, USA · DIFFER - Dutch Institute for Fundamental Energy Research, De Zaale 20, 5612 AJ Eindhoven, the Netherlands
Eigenbasis-Independent Learnable Spectral Positional Encodings for Directed Graphs via Hermitian Block Krylov Subspaces
Jul 8, 2026Jiaqing Xie, Yuxin WangGraph Edge Sparsification Graph Laplacians
Fudan University
Collective Intelligence with Foundation Models
Jul 6, 2026J. de Curtò, I. de ZarzàMulti-Agent Reasoning Heterogeneous Modeling Tools
Department of Computer Applications in Science & Engineering, BARCELONA Supercomputing Center, 08034 Barcelona, Spain · Escuela Técnica Superior de Ingeniería (ICAI), Universidad Pontificia Comillas, 28015 Madrid, Spain · Human Centered AI, Data & Software, LUXEMBOURG Institute of Science and Technology, L-4362 Esch-sur-Alzette, Luxembourg
A Near-Linear-Time Solver for Graph $p$ -Laplacian Semi-Supervised Learning via Continuation in $p$
Jul 3, 2026Oren E. LivneGraph Laplacians Solver Iterations
Pine Birch Analytics, Churchville, PA
SNAP-FM: Sparse Nonlinear Accelerated Projection for Physics-Constrained Generative Modeling
Jun 30, 2026Alaina Kolli, Theodoros Xenakis, Utkarsh Utkarsh +4Inequality Constraints Solver Iterations
Massachusetts Institute of Technology, Cambridge, MA, USA · Norwegian University of Science and Technology, Trondheim, Norway
Extrapolating from Regularised Solutions for Solving Ill-Conditioned Linear Systems in Machine Learning
Jun 29, 2026Disha Hegde, Jon Cockayne, Chris. J. OatesSolver Iterations Regularization
University of Southampton, UK · Newcastle University, UK · The Alan Turing Institute, UK
Spectrally Safe Neural Operator Warm-Starts for Large-Scale Newton Solvers
Jun 20, 2026Jaemin Oh, Youngkyu Lee, Jerome Darbon +1Solver Iterations Neural Operators
Division of Applied Mathematics, Brown University, Providence, RI 02912, USA
Memory Is No Longer a Bottleneck: Memory-Efficient Graph Filtering for Scalable Collaborative Filtering
Jun 19, 2026Jin-Duk Park, Won-Yong ShinCollaborative Filtering Solver Iterations
School of Mathematics and Computing (Computational Science and Engineering), Yonsei University, Seoul 03722, Republic of Korea
A fast direct solver based neural network for solving PDEs
Jun 18, 2026Jashwanth Reddy Kadaru, Vaishnavi GujjulaNeural Partial Differential Equation Solvers Partial Differential Equations
Department of Computer Science & Engineering, International Institute of Information Technology Bangalore (IIIT-B), India · Department of Data Science and Artificial Intelligence, International Institute of Information Technology Bangalore (IIIT-B), India
Stable and Scalable Probabilistic Numerical Solvers for Stiff and High-Dimensional ODEs
Jun 6, 2026Nathanael BoschSolver Iterations Ordinary Differential Equations
EPFL, Lausanne, Switzerland
GLENS: Global Search via Learning from Solver Iterates with Diffusion Models
May 29, 2026Anjian Li, Bartolomeo Stellato, Ryne BeesonLarge Neighborhood Search Convex Optimization
Department of Electrical and Computer Engineering, Princeton University, Princeton, 08544, NJ, USA. · Department of Operations Research and Financial Engineering, Princeton University, Princeton, 08544, NJ, USA. · Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, 08544, NJ, USA.
LoRe: Adaptive Interaction-Evaluation Routing with Per-Step Interaction Budgets for Iterative Graph Solvers
May 27, 2026Jintao Li, Yong-Yi Wang, Zheng-An Wang +1Neural Solvers Solver Iterations
Beijing Key Laboratory of Fault-Tolerant Quantum Computing, Beijing Academy of Quantum Information Sciences, Beijing, China · Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, CAS, Beijing, China · Beijing Key Laboratory of Advanced Quantum Technology, Beijing, China +1
Accelerating Birkhoff Projection for Manifold-Constrained Hyper-Connections
May 26, 2026Chenrui Wang, Yixuan QiuSolver Iterations Projection
RenminSchoolUniversityof Statisticsof China · School of Statistics and Data Science & Institute of Big Data Research · Shanghai University of Finance and Economics
Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation
May 18, 2026Mingfei SunPolicy Gradient Backpropagation
The University of Manchester, United Kingdom.
RL4RLA: Teaching ML to Discover Randomized Linear Algebra Algorithms Through Curriculum Design and Graph-Based Search
May 18, 2026Jinglong Xiong, Xiaotian Liu, Ruoxin Wang +4Solver Iterations Low-Rank Structure
Pratt School of Engineering, Duke University, Durham, NC, USA · Department of Computer Science, Dartmouth College, Hanover, NH, USA.
Lightweight Gaussian Process Inference in C++ on Metal and CUDA
May 18, 2026Yu-Hsueh FangGaussian Process Cpu-Gpu Hybrid Designs
Department of Information Management, National Taiwan University · 2H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology
Learning Fill-in Reduction Ordering via Graph Policy Optimization for Sparse Matrices
May 17, 2026Ziwei Li, Shuzi Niu, Huiyuan Li +2Tensor Completion Solver Iterations
Institute of Software, Chinese Academy of Sciences, Beijing, China
Local Inverse Geometry Can Be Amortized
May 13, 2026Aaditya L. KachhadiyaBayesian Inverse Problems Solver Iterations
Independent Researcher Surat, India
Adaptive Diagonal Loading using Krylov Subspaces for Robust Beamforming
May 11, 2026Manan Mittal, Ryan M. Corey, John R. Buck +1Beamforming Microphone Array
Stony Brook University1 · University of Illinois Chicago2 · University of Massachusetts Dartmouth3
Affine Tracing: A New Paradigm for Probabilistic Linear Solvers
May 11, 2026Disha Hegde, Marvin Pförtner, Jon CockayneSolver Iterations Affine
University of Southampton · AI Center, University of Tübingen
cuRegOT: A GPU-Accelerated Solver for Entropic-Regularized Optimal Transport
May 9, 2026Yixuan QiuFused Sinkhorn-Localized Similarity Cpu-Gpu Hybrid Designs
School of Statistics and Data Science & Institute of Big Data Research Shanghai University of Finance and Economics
NSPOD: Accelerating Krylov solvers via DeepONet-learned POD subspaces
May 8, 2026Francesc Levrero-Florencio, Youngkyu Lee, Jay Pathak +1Algebraic Multigrid Solver Iterations
Synopsys UK Ltd, UK · Division of Applied Mathematics, Brown University, Rhode Island, USA · Synopsys Inc, California, USA
Solving Minimal Problems Without Matrix Inversion Using FFT-Based Interpolation
May 7, 2026Haidong Wu, Snehal Bhayani, Janne HeikkiläSolver Iterations Matrix
Center for Machine Vision and Signal Analysis University of Oulu, Oulu, Finland
Direct Estimation of Schrödinger Bridge Time-Series Drifts: Finite-Sample, Asymptotic, and Adaptive Guarantees
May 6, 2026Othmane Mazhar, Huyên PhamSchrödinger Bridges Finite-Sample
LPSM, Sorbonne Université and Université Paris Cité · École Polytechnique, CMAP
Decision-Focused Learning via Tangent-Space Projection of Prediction Error
May 2, 2026Junhyeong Lee, Sangjin Jin, Yongjae LeePlan Regret Prediction Error
Department of Industrial Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea.
An Efficient Multilevel Preconditioned Nonlinear Conjugate Gradient Method for Incremental Potential Contact
Apr 21, 2026Yu Zhang, Xing Shen, Kemeng Huang +5Solver Iterations Spectral Preconditioning
S-Lab, Nanyang Technological University, Singapore · Shanghai AI Laboratory, China · University of Hong Kong, China +3
Towards Universal Convergence of Backward Error in Linear System Solvers
Apr 17, 2026Michał Dereziński, Yuji Nakatsukasa, Elizaveta RebrovaSolver Iterations Convergence
University of Michigan, Ann Arbor, MI · University of Oxford, Oxford, UK · Princeton University, Princeton, NJ
Stability and Bifurcation Analysis of Nonlinear PDEs via Random Projection-based PINNs: A Krylov-Arnoldi Approach
Mar 23, 2026Gianluca Fabiani, Michail E. Kavousanakis, Constantinos Siettos +1Partial Differential Equations Parametric Physics-Informed Neural Network
Hopkins Extreme Materials Institute, Johns Hopkins University, Baltimore, 21218, MD, USA · Dept. of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, 21218, MD, USA · School of Chemical Engineering, National Technical University of Athens, 9 Iroon Polytechniou Street, Athens, 15772, Greece +2
Unbiased and Biased Variance-Reduced Forward-Reflected-Backward Splitting Methods for Stochastic Composite Inclusions
Mar 16, 2026Quoc Tran-Dinh, Nghia Nguyen-TrungVariance Reduction Solver Iterations
Department of Statistics and Operations Research The University of North Carolina at Chapel Hill 318 Hanes Hall, UNC-Chapel Hill, NC 27599-3260.
Precision autotuning for linear solvers via contextual bandit-based RL
Jan 2, 2026Erin Carson, Xinye ChenSolver Iterations Full-Precision Performance
Charles University Prague, Czech · Sorbonne Université, CNRS, LIP6 Paris, France
Multiple Testing of Linear Forms for Noisy Matrix Completion
Dec 1, 2023Wanteng Ma, Lilun Du, Dong Xia +1Tensor Completion False Discovery Rate
Department of Statistics and Data Science, University of Pennsylvania, USA · Department of Decision Analytics and Operations, City University of Hong Kong, Hong Kong · Department of Mathematics, Hong Kong University of Science and Technology, Hong Kong +1
Scalable Krylov Subspace Methods for Generalized Mixed-Effects Models with Crossed Random Effects
Date pendingPascal Kündig, Fabio SigristGeneralized Linear Model Solver Iterations
Lucerne University of Applied Sciences and Arts · University of Basel · Seminar for Statistics, ETH Zurich

Sep 29, 2026, cs.LGJ/K move · Enter open · S save

The Advantages of Fresh Sketching for Ridge Regression

Linkai Ma, Qilin Li, Petros Drineas

Purdue University · University of Wisconsin-Madison

Kernel Ridge Regression Sketches Convergence Solver Iterations

Open paper AskPDF arXiv

Over the past 25 years, sketching and sampling have become widely used tools for accelerating large-scale regression. In iterative randomized solvers, a basic design choice is whether to

\textit{reuse}

the same sketch or draw

\textit{fresh}

randomness at every step. For (under-constrained) iterative ridge regression with column sampling, whether fresh sketches offer provable advantages has remained open:

\textit{We show that they do.}

Fresh sketching lets us analyze error only along the current residual solution, rather than uniformly over the entire Gram matrix. This directional view yields sharper convergence guarantees for leverage score and ridge leverage score sampling and, more importantly, leads to residual-aware sampling rules. By minimizing the variance of the relevant sketched matrix-vector product, we derive an oracle distribution and practical approximations to the oracle distribution, including a mixture sampling distribution with (somewhat weaker) convergence guarantees. Experiments on synthetic and real data, including ridge probes on Qwen2.5 representations, support our theory, showing substantially faster convergence.

Momentum

Related topics

Latest papers 46