Smoothness

Ask about this topic

Momentum

3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 27

All topics
CardsList

  1. Optimal Stochastic Bilevel Optimization with First-Order Oracles

    Oct 1, 2026Linxuan Pan, Junchi YangBilevel OptimizationFirst Order Oracle Complexity

    The Chinese University of Hong Kong, Shenzhen

  2. Lower Bounds for Stochastic First-Order Algorithms with Variance Reduction in Nonconvex--Concave Minimax Optimization

    Oct 1, 2026Jiayi Song, Zi XuConvex OptimizationLower Bounds

    Department of Mathematics, College of Sciences, Shanghai University, Shanghai 200444, China

  3. Convergence Analysis of STORM Under Different Geometries

    Oct 1, 2026Wei Jiang, Yibo Wang, Wenhao Yang +3Stochastic Convex OptimizationConvex Optimization

    School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China · School of Artificial Intelligence, Nanjing University, Nanjing, China

  4. Adam under Generalized Smoothness with Second-Moment-Type Stochastic Gradients

    Sep 29, 2026Ruinan Jin, Difei Cheng, Ling Chen +3SmoothnessAdam

    Mohamed bin Zayed University of Artificial Intelligence · Aerospace Information Technology University · The Ohio State University +2

  5. A Differentiable Optimization Framework for Registering Sequential Bounding Boxes with Point Cloud Stream

    Sep 28, 2026Xuesong Li, Jinguang Tong, Jie HongPoint Cloud RegistrationBounding Box

    CSIRO · The University of Hong Kong

  6. FAHCD-Net: Frequency-Adaptive Heatmap-Conditional Diffusion Networks for Robust Facial Landmark Detection

    Sep 15, 2026Jun Wan, Jiwei Hu, Shengkai Hu +1One-Shot Medical Landmark DetectionBlind Face Restoration

    School of Information Engineering, Zhongnan University of Economics and Law, Wuhan 430073, China

  7. Projection-Free Multi-level Algorithms for Stochastic Constrained Compositional Optimization

    Sep 14, 2026Wei Jiang, Sifan Yang, Wenhao Yang +4Convex OptimizationStochastic Optimization

    School of Computer Science and Engineering, Nanjing University of Science and Technology, China · School of Artificial Intelligence, Nanjing University, China · School of Software Technology, Zhejiang University, China

  8. What is Smoothness?

    Sep 3, 2026Zachary P BradshawSmoothnessFinite Groups

    QodeX Quantum

  9. Generalized Convexity and Smoothness via Conjugate Duality: Optimization Theory for Deep Neural Networks

    Aug 10, 2026Binchuan QiGradient DescentSmoothness

    College of Electronics and Information Engineering Tongji University Shanghai, 200092, China

  10. XMix: Combating Extremely Noisy Labels via Local Smoothness in Self-Supervised Feature Space

    Jul 26, 2026Chengqi Li, Yangdi Lu, Zhihao Shi +3Noisy LabelsSemi-Supervised Learning

    Department of Computing and Software, McMaster University · Département de génie logiciel et TI, École de Technologie Supérieure

  11. What's in a Smoothness Constant? Tighter Rates for Local SGD with Bounded Second-order Heterogeneity

    Jul 16, 2026Kumar Kshitij Patel, Rustem Islamov, Sebastian U Stich +3SmoothnessStochastic Gradient Descent

    Department of Mathematics and Computer Science University of Basel Basel, Switzerland 4001 · Simons Institute for the Theory of Computing, Berkeley · Department of Data Science New Jersey Institute of Technology Newark, NJ, USA 07102

  12. A Function-Space Dichotomy for Compositional Learning: Exponential Sub-Optimality of the Neural Tangent Kernel

    Jul 7, 2026Arkaprabha Ganguli, Emil ConstantinescuNeural Tangent KernelRectified Linear Unit Networks

    Mathematics & Computer Science Division, Argonne National Laboratory, Lemont, IL, USA

  13. Graph Dimensionality Reduction for Contextual Bandits: Structure-Specific Regret Bounds under Approximate Smoothness and Noisy Eigenspaces

    Jun 26, 2026Joyanta Jyoti Mondal, Ibne Farabi Shihab, Anuj SharmaContextual Bandit FrameworkDimensionality Reduction

    Department of Computer and Information Sciences, University of Delaware, USA · Department of Computer Science, Iowa State University, USA · Department of Civil, Construction & Environmental Engineering, Iowa State University, USA

  14. Improved Guarantees for Langevin Monte Carlo with Average Smoothness

    May 29, 2026Arnak S. Dalalyan, Avetik KaragulyanLangevin DynamicsLog-Concave Distributions

    CREST, ENSAE Paris, Institut Polytechnique de Paris and MBZUAI · L2S, CNRS, Centrale Supélec, Université Paris-Saclay

  15. Approximation and learning of anisotropic and mixed smooth functions by deep ReLU neural networks

    May 29, 2026Yunfei Yang, Jun FanLogarithmic Sobolev InequalitiesRectified Linear Unit Networks

    School of Mathematics (Zhuhai) and Guangdong Province Key Laboratory of Computational Science, Sun Yat-sen University, Zhuhai, China. · Department of Mathematics, Hong Kong Baptist University, Kowloon, Hong Kong, China.

  16. Convergence of Steepest Descent and Adam under Non-Uniform Smoothness

    May 28, 2026Sharan Vaswani, Yifan Sun, Reza BabanezhadGradient DescentSmoothness

    1Simon Fraser University · 2Stony Brook University · 3Samsung AI, Montreal.

  17. Beyond Bounded Variance: Variance-Reduced Normalized Methods for Nonconvex Optimization under Blum-Gladyshev Noise

    May 14, 2026Antesh Upadhyay, Arda Fazla, Abolfazl HashemiStochastic Convex OptimizationStochastic Gradient Descent

    School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA.

  18. Fitting Is Not Enough: Smoothness in Extremely Quantized LLMs

    May 9, 2026Yuzhuang Xu, Xu Han, Yuxuan Li +2Large Language Model QuantizationSmoothness

    1Harbin Institute of Technology, Harbin, China · 2Tsinghua University, Beijing, China

  19. Temporal Smoothness Doubly Robust Learning for Debiased Knowledge Tracing

    May 7, 2026Peilin Zhan, Wei Chen, Weilin Chen +2LearnabilitySelection Bias

    School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, China

  20. Universal Smoothness via Bernstein Polynomials: A Constructive Approximation Approach for Activation Functions

    May 4, 2026Wentao Zhang, Yutong Zhang, Yifan Zhu +1Activation FunctionsSmoothness

    Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · College of Computer Science, Sichuan University, Chengdu, China

  21. Black-box optimization of noisy functions with unknown smoothness

    May 4, 2026Jean-Bastien Grill, Michal Valko, Rémi MunosBlack-Box OptimizationSmoothness

    SequeL team, INRIA Lille - Nord Europe, France · Google DeepMind, UK∗

  22. KANs need curvature: penalties for compositional smoothness

    May 4, 2026James BagrowKolmogorov-Arnold NetworksActivation Functions

    Mathematics & Statistics, University of Vermont, Burlington, VT, United States · Vermont Complex Systems Center, University of Vermont, Burlington, VT, United States

  23. Stochastic simultaneous optimistic optimization

    Apr 27, 2026Michal Valko, Alexandra Carpentier, Rémi MunosSmoothnessMaximization

    INRIA Lille - Nord Europe, SequeL team, 40 avenue Halley 59650, Villeneuve d’Ascq, France · Statistical Laboratory, CMS, Wilberforce Road, CB3 0WB, University of Cambridge, United Kingdom

  24. Exploring Sparsity and Smoothness of Arbitrary Lp Norms in Adversarial Attacks

    Feb 6, 2026Christof Duhme, Florian Eilers, Xiaoyi JiangSpectral NormSmoothness

    Department of Computer Science University of Münster Münster, Germany

  25. An Elementary Proof of the Near Optimality of LogSumExp Smoothing

    Dec 11, 2025Thabo Samakhoana, Benjamin GrimmerMaximizationSmoothness

    Johns Hopkins University, Department of Applied Mathematics and Statistics

  26. Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos

    Dec 1, 2025Xavier Thomas, Youngsun Lim, Ananya Srinivasan +2Human Motion GenerationHuman Motion

    Boston University · Belmont High School · Canyon Crest Academy +1

  27. Better Convergence Guarantees for Sign-Based Momentum Methods

    Jul 16, 2025Wei Jiang, Dingzhi Yu, Sifan Yang +3Momentum Stochastic Gradient DescentConvergence

    National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China · School of Artificial Intelligence, Nanjing University, Nanjing, China