Adam

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

6 new papers

A weekly snapshot of new work published in Adam.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Adam.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Adam.

Inside this field

Focused directions

293 papers

Latest in Adam

Browse all topics →
CardsList

  1. QScheduler: Adaptive Gradient Sampling for Zeroth-Order On-Device Training on INT8 NPUs

    Jul 21, 2026Victor Felipe Domingues Do Amaral, Pierre Demaj, Erwan Libessart +3Neural Processing UnitsZeroth-Order Optimization

  2. PoLoRA: A Preconditioned Orthogonalized LoRA Optimizer

    Jul 20, 2026Nikhil Ghosh, Tetiana Parshakova, Robert M. GowerLow-Rank AdaptationOptimizer Design

  3. ADMM-Based Safety-Critical Distributed NMPC for Cooperative Transportation by Quadrupedal Robots

    Jul 18, 2026Ruturaj S. Sambhus, Kapi Ketan Mehta, Yicheng Zeng +1Multi-Robot SystemsModel Predictive Control

  4. Backpropagation-Free Trunk Training via the Split Forward Gradients

    Jul 18, 2026Tian Qin, Wei-Min HuangBackpropagationGradient Flow

  5. Adaptive Runge-Kutta Step Control Buys Training Loss, Not Generalization: An Honest Compute-Matched Study of RK-Adam Optimizers

    Jul 16, 2026Akhilesh GogikarAdamLearning Rates

  6. Reassessing Muon for Matrix Factorization

    Jul 14, 2026Ali Parviz, Gal Mishne, Alex CloningerMuon OptimizerMuon

  7. M+Adam: Low-Precision Training via Additive-Multiplicative Optimization

    Jul 12, 2026Xiaoyuan Liang, Sebastian Loeschcke, Mads Toftrup +1AdamM+Adam

  8. Learning in Curved Weight Space:Exponential-Linear Weight Reparameterization for Improved Optimization

    Jul 10, 2026Ethan SmithNeural Network OptimizationWeight-Space

  9. Sampling on Random Subspaces under Limited Data in the Context of Exploratory Landscape Analysis

    Jul 8, 2026Iván Olarte Rodríguez, Anja Jankovic, Thomas Bäck +1Optimization LandscapeLimited Data

  10. An optimal control approach for neural network architecture adaptation with a posteriori error estimation

    Jul 8, 2026C G Krishnanunni, Thomas Scott, Tan Bui-ThanhNeural-Network ApproximationNeural Network Optimization

  11. Restricted Dynamic Geometric Complexity: Path-Space Reduction and Möbius--Jacobi Response

    Jul 8, 2026Zavier LiSpectral PreconditioningInformation-Geometric Optimization

  12. The Anatomy of Implicit Bias: Information Allocation in Neural Network Training

    Jul 8, 2026Zhang Gongyue, Wang Zhiyong, Liu Donghan +3Neural Network OptimizationSpectral Preconditioning

  13. Differentially Private Natural Gradient Descent

    Jul 7, 2026Pan Li, Kai Chen, Shuai Chang +3Differential PrivacyStochastic Gradient Descent

  14. Unified convergence analysis for gradient descent optimization methods in the training of deep neural networks

    Jul 5, 2026Shokhrukh Ibragimov, Arnulf JentzenNeural Network OptimizationAdam

  15. OmniOpt: Taxonomy, Geometry, and Benchmarking of Modern Optimizers

    Jul 4, 2026Siyuan Li, Jiabao Pan, Yumou Liu +9Optimizer DesignMle-Bench Lite

  16. Directional Curvature from Armijo Backtracking: A Low-Cost Sharpness Probe and a Calibration-Free Learning-Rate Safeguard for Adam

    Jul 4, 2026Ashmitha R, Jörg FrochteAdamLearning Rates

  17. On the Convergence of Adam, Revisited

    Jul 3, 2026Steven Heilman, Sampad MohantyAdamFederated Averaging

  18. Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging

    Jul 3, 2026Yu Mitsuzumi, Akisato Kimura, Yasuhiro Fujiwara +1Stable Test-Time AdaptationContinual Test-Time Adaptation

  19. Optimality-Informed Neural Networks for Lunar Landing Trajectory Optimization

    Jul 2, 2026Zhenbo WangOptimal ControlNeural Network Optimization

  20. Beyond Adam: SOAP and Muon for Faster, Label-Efficient Training of Machine Learning Interatomic Potentials

    Jul 2, 2026Gil Harari, Yoel Zimmermann, Ola Tangen Kulseng +4Interatomic PotentialsAdam

  21. SCAPE: Accurate and Efficient LLM Training with Extreme Sparse Communication

    Jul 2, 2026Mingkai Zheng, Junlin Chen, Haotian Xie +1Large ModelsSparsity

  22. Token Geometry

    Jul 1, 2026Kathan ShahOptimizer Design

  23. Neural Certificate Pricing for Combinatorial Optimization Problems

    Jul 1, 2026Jingyi Chen, Xinyuan Zhang, Xinwu QianCombinatorial OptimizationNeural Network Optimization

  24. ZO-Act: Efficient Zeroth-Order Fine-Tuning via One-Shot Activation-Informed Low-Rank Subspaces

    Jul 1, 2026Xun Dong, Yibo Xu, Naigang Wang +3Continual Fine-TuningLarge Language Model Fine-Tuning

  25. Muon as a Residual Connection

    Jul 1, 2026Hao HuangMuon OptimizerMuon

  26. Bilevel Optimization for Neural Architecture Search

    Jun 28, 2026Abhishek Shukla, Ankur Sinha, Faiz HamidNeural Architecture SearchBilevel Optimization

  27. Dead-Direction Conditioners: Gauge-Equivariant Preconditioning for Deep Networks

    Jun 28, 2026Tejas Pradeep ShirodkarAdamDeep Network

  28. Analysis of Adam Algorithms for Stochastic Dynamic Systems

    Jun 27, 2026Xin Zheng, Yifei Jin, Lei GuoAdamStochastic Dynamics

  29. Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization

    Jun 26, 2026Shuang Li, Zhihui Zhu, Qiuwei LiConvex OptimizationNonconvex

  30. Non-Linear Strategic Classification Made Practical

    Jun 26, 2026Jack Geary, Boyan Gao, Henry GoukLearning-Augmented AlgorithmsZeroth-Order Optimization

  31. MMAO: A Metabolic Multi-Agent Optimizer with Endogenous Resource Allocation for Continuous and Discrete Optimization

    Jun 26, 2026Jinliang Xu, Liping MaMetaheuristicsMetabolic

  32. Tensorion: A Tensor-Aware Generalization of the Muon Optimizer

    Jun 24, 2026Vladimir Bogachev, Vladimir Aletov, Alexander Molozhavenko +2Muon OptimizerAdam

  33. Improving Neural Network Training by Decoupling the Magnitude and Direction of Weight Vectors

    Jun 24, 2026Alexander Hägele, Alejandro Hernández-Cano, Atli Kosson +1Neural Network OptimizationModel Weights

  34. A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients

    Jun 23, 2026Yanwei Jia, Du Ouyang, Huyên Pham +1Partial Differential EquationsAutomatic Differentiation

  35. Fast and Slow Variational Continual Learning

    Jun 22, 2026Subarnaduti Paul, Yohan Jung, Mohammad Emtiyaz Khan +3Efficient Continual LearningContinual Learning Methods

  36. Open Problem: Is AdamW Effective Under Heavy-Tailed Noise?

    Jun 22, 2026Dingzhi Yu, Hongyi Tao, Yuanyu Wan +2AdamLong-Tailed Distribution

  37. FORGE: Fused On-Register Gradient Elimination for Memory-Efficient LLM Training

    Jun 22, 2026Dikshant Kukreja, Kritarth Prasad, Avinash Anand +6Gradient FlowOptimizer Design

  38. GeoRouteNet: Geometry-Enhanced Non-Autoregressive Neural Solver for the Traveling Salesman Problem

    Jun 22, 2026Xiang LiSalesman ProblemNeural Solvers

  39. Adam Converges in Nonsmooth Nonconvex Optimization

    Jun 21, 2026Zijian LiuAdamConvex Optimization

  40. Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective

    Jun 19, 2026Tianqi Shen, Jinji Yang, Runze Shi +3Muon OptimizerMuon

  41. Central limit theorem for the averaged Adam optimizer

    Jun 19, 2026Steffen Dereich, Arnulf JentzenCentral Limit TheoremStochastic Approximation

  42. AdaMem: Learning What to Remember with Adaptive Memory Policies for Personalized Agents

    Jun 19, 2026Xingyu Chen, Rui Wang, Zhaopeng Tu +1Long-HorizonClosed-Book Question Answering

  43. Towards Robust Training in NNGPT AutoML Pipeline: A Loss-Optimizer Pairing Selection Study

    Jun 18, 2026Anton Abramochkin, Radu Timofte, Dmitry IgnatovNeural Architecture SearchAdam

  44. Provably Sub-Linear Two-Timescale NeuroEvolution with Online Plasticity

    Jun 18, 2026Shishen Lin, Yixin ChenNeural ControlLearning-Augmented Algorithms

  45. Deep-Unfolded Coordination

    Jun 18, 2026Hunter Kuperman, Minchan Jung, Rahul V. Ghosh +2Multi-Agent CoordinationDeep Unfolding Networks

  46. On the Oracle Complexity of Interpolation-Based Gradient Descent

    Jun 18, 2026Dongmin Lee, William Lu, Anuran MakurGradient DescentEmpirical Risk Minimization

  47. NeuronFabric: A Software Reference Architecture for On-Chip Transformer Training with Local Adam

    Jun 15, 2026Evgeny UkladchikovTransformer ArchitecturesField-Programmable Gate Arrays

  48. MSC-CMA-ES: Structure-Aware Restarts for CMA-ES via Cyclic Nearest-Better Basin Discovery

    Jun 14, 2026Dimitar Nedanovski, Svetoslav Nenov, Dimitar PilevMetaheuristicsBasin

  49. Schattor: Schatten-family methods for deep learning optimization

    Jun 14, 2026Bohao Ma, Junyu Zhang, Chuan HeStochastic OptimizationNeural Network Optimization

  50. AdaMame: A Training Recipe for Adaptive Multilingual Reasoning

    Jun 13, 2026Dayeon Ki, Kevin Duh, Marine CarpuatMultilingual ReasoningLarge Language Model Reasoning

  51. Zero-order Parameter-free Optimization for LMO-based Methods: Novel Approach for Efficient Fine-tuning

    Jun 12, 2026Dmitriy Bystrov, Daniil Medyakov, Dmitry Bylinkin +1Parameter-Efficient Fine-TuningLarge Language Model Fine-Tuning

  52. A Knowledge Theory of Capital:The Value of Natural and Artificial Intelligence, Volume 1

    Jun 12, 2026Jeffrey GardinerValueGoverned

  53. Beyond a Single Explanation of the Adam--SGD Gap

    Jun 12, 2026Chenxiang Zhang, Rustem Islamov, Enea Monzio Compagnoni +3AdamM+Adam

  54. Gefen: Optimized Stochastic Optimizer

    Jun 11, 2026Nadav Benedek, Tomer Koren, Ohad FriedAdamScaling Laws

  55. How Much Memory Do We Need? Adaptive Memory Gate for Neural Operators

    Jun 11, 2026Jihyeon Hur, Yongseok Kwon, Min-Gi Jo +2Neural OperatorsNeural Network Optimization

  56. Different Layers, Different Manifolds: Module-Wise Weight-Space Geometry in Transformer Optimization

    Jun 11, 2026Kirato YoshiharaManifoldsNeural Network Optimization

  57. Weibull Weight-Scale Parameter Evolution under AdamW Training Dynamics

    Jun 11, 2026Tiexin DingAdamModel Weights

  58. Structure from Reasoning, Numbers from Search: On-Premise Open LLMs as Structural Priors for Coupled MIMO Controller Tuning

    Jun 9, 2026Jiaxuan Chen, Haonan Li, Yang ShuTuningFeedback Linearization

  59. Preserving Plasticity in Continual Learning via Dynamical Isometry

    Jun 8, 2026Andries Rosseau, Robert Müller, Ann NowéPlasticityEfficient Continual Learning

  60. Muon Learns More Robust and Transferable Features than Adam

    Jun 8, 2026Tianyu Ruan, Fengzhuo Zhang, Shuche Wang +1AdamFeature Learning