Gradient

Ask about this topic

Momentum

28 papers in the last four weeks, up 56% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 217

All topics
CardsList

  1. From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation

    Oct 1, 2026Siqi Zhu, Suozhi Huang, Kaixuan Zhang +4Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    University of Illinois Urbana-Champaign · Princeton University · Westlake University

  2. Comparing a gradient boosting algorithm to the GOES FDC for wildfire detection

    Oct 1, 2026Asaf Vanunu, Boaz Nadler, Arnon KarnieliWildfire DetectionXgboost Model

    The Albert Katz International School for Desert Studies, The Jacob Blaustein Institutes for Desert Research, Sde Boker Campus, Ben-Gurion University of the Negev, Midreshet Ben-Gurion 84990, Israel · The Goldman Sonnenfeldt School of Sustainability and Climate Change, Ben-Gurion University of the Negev, Beer Sheva 8410501, Israel · The Remote Sensing Laboratory, French Associates Institute for Agriculture and Biotechnology of Drylands, The Jacob Blaustein Institutes for Desert Research, Sde Boker Campus, Ben-Gurion University of the Negev, 84990, Israel +1

  3. Reinforcement Learning to Accelerate Primal-Dual Hybrid Gradient for Linear Programming

    Oct 1, 2026Jinhwan Sul, Alex Oshin, Evangelos A. TheodorouLinear ProgrammingPrimal-Dual Methods

    Georgia Institute of Technology, USA

  4. Least-time Gradient Flow

    Oct 1, 2026Alessandro Betti, Marco Gori, Stefano Melacci +1Wasserstein Gradient FlowsGradient

    Department of Mathematics “Tullio Levi-Civita”, University of Padua, Italy. · Department of Information Engineering and Mathematics, University of Siena, Italy. · University of Florence, Italy.

  5. Backward-State Policy Is Part of the Learning Algorithm

    Sep 30, 2026Shuxiao Xie, Shuyang Xie, Dezhi Ran +2Backward PassesGradient

    Beijing Tongming Lake Information Technology Application Innovation Center (TLAIC), China

  6. A Generalizable and Explainable Framework for Synthetic Video Detection Using First-Digit Gradient Statistics

    Sep 30, 2026Sidharth Shanu, Gautam Kumar, Tej SinghAi-Generated Video DetectionDigital Forensics

    B.Tech CSE IIT Jodhpur, India · School of Automation & Robotics GGSIPU, New Delhi, India · Centre for Artificial Intelligence MITS Gwalior, India

  7. Learn-Then-Differentiate Gradient Estimation

    Sep 30, 2026Nifei Lin, Qingkai Zhang, L. Jeff HongGradientImplicit Differentiation

    Research Institute for Interdisciplinary Sciences, School of Information Management and Engineering, Shanghai University of Finance and Economics, Shanghai 200433, China · Department of Decision Analytics and Operations, City University of Hong Kong, Hong Kong, China · Department of Industrial and Systems Engineering, University of Minnesota, Minneapolis, Minnesota 55455

  8. Same Loss, Different Gradients

    Sep 30, 2026Ningkang Peng, Xiaoqian Peng, Yifan He +4Differentiable OptimizationGradient

    Nanjing Normal University · Nanjing University of Chinese Medicine

  9. dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale

    Sep 30, 2026Shixuan Liu, Tongli Zhou, Junwei Deng +2Large Language Model TrainingLarge Language Models(Llms

    University of Illinois at Urbana-Champaign · Google

  10. Aegis: Generative Gradient Masking for Privacy-Preserving Medical Federated Learning

    Sep 29, 2026Chaoyu Zhang, Shanghao Shi, Heng Jin +3Federated LearningGradient

    Virginia Tech · Washington University in St. Louis · University of South Florida

  11. Unifying Distributional Training for One-Step Visual Generation

    Sep 28, 2026Chi Zhang, Shi Haoyang, Yueyi Liu +9Generative Flow NetworksVisual Generation

    Tsinghua University · Fudan University · Xi’an Jiaotong University +4

  12. ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning

    Sep 28, 2026Yihang Chen, Yuanhao Ban, Cho-Jui HsiehOff-Policy LearningReinforcement Learning With Verifiable Reward

    Department of Computer Science, University of California, Los Angeles

  13. Convex Optimization Is Free When Accuracy Is Expensive

    Sep 28, 2026Arthur Paing, Arthur JacotConvex OptimizationFirst Order Oracle Complexity

    Ecole polytechnique Palaiseau, France · Courant Institute, NYU New York, USA

  14. CTP-FL: Common-Trajectory Gradient Prediction for Federated Learning

    Sep 28, 2026Junkang LiuFederated LearningGradient

    Tianjin University

  15. ORPG: Reconciling Multiple Reward Objectives through Objective-wise Policy Gradients

    Sep 28, 2026Shicheng Fang, Yiwen Zhao, Wenbo Tian +4Reward-Only Policy Optimization VariantsGradient Component

    Fudan University · Shanghai Innovation Institute

  16. On Parameter Symmetries and Conservation Laws in Gradient Flow

    Sep 28, 2026Khang Nguyen, Guido MontúfarSymmetryGradient

    UCLA · UCLA & MPI MiS

  17. DGS-MLDG: Domain Gradient Surgery Guided Meta-Learning for Domain Generalization in Speech Deepfake Detection

    Sep 27, 2026Siqing Qin, Kong Aik Lee, Youzhi Tu +2Multimodal Domain GeneralizationMeta-Learning

    Dept. of Electrical and Electronic Engineering, The Hong Kong Polytechnic University · College of Computing and Data Science, Nanyang Technological University

  18. The cost of useful natural gradient updates

    Sep 27, 2026Subhransu S. Bhattacharjee, Dylan Campbell, Rahul ShomeFisher Information MatrixGradient

    School of Computing, The Australian National University

  19. CompliantWBC: Whole-Body Compliance for Heavy Humanoids via Force Latent Estimation and Residual Impedance Targets

    Sep 27, 2026Tan-Dzung Do, Cuc T. Trinh, Tuan Dat Phuong +4Whole-Body ControlImpedance Control

    VinRobotics · National University of Singapore · VinUniversity +1

  20. Temporal Gradient Inversion for Private Trajectory Reconstruction in Embodied Reinforcement Learning

    Sep 24, 2026Sudip Bhujel, Shanghao Shi, Ruiquan Huang +2Gradient-Based AttacksOffline Reinforcement Learning

    Department of Computer Science, University of Kentucky · Department of Computer Science and Engineering, Washington University in St. Louis

  21. FairMean: Promoting Fairness in Distributed Learning under Label Poisoning Attacks

    Sep 22, 2026Huigan Zheng, Jiaojiao Zhang, Yongxiang LiuAlgorithmic FairnessBalanced Learning

    Sun Yat-Sen University · Pengcheng Laboratory · Great Bay University

  22. Gradient Descent with Stochastic Subspaces via Persistence of Memory

    Sep 16, 2026Subhroshekhar Ghosh, Clement Z. Q. Ng, Pierre-Louis Poirion +1Stochastic Gradient DescentGradient Descent

    Department of Mathematics, National University of Singapore, Singapore · Center for Advanced Intelligence Project, RIKEN, Tokyo, Japan · Department of Mathematical Informatics, The University of Tokyo, Tokyo, Japan

  23. Preservation of Log-Concavity and Convergence of Wasserstein-Fisher-Rao Gradient Flows

    Sep 16, 2026Francesca Romana Crucinio, Sahani PathirajaWasserstein Gradient FlowsLog-Concave Distributions

    ESOMAS, University of Turin, Italy & Collegio Carlo Alberto, Turin, Italy · School of Mathematics & Statistics, UNSW Sydney, Australia

  24. Online Gradient Computation for Warping Gaussian Process Transformations

    Sep 15, 2026Emilio Ruiz-Moreno, Konstantinos Slavakis, Baltasar Beferull-LozanoGaussian ProcessWasserstein Gradient Flows

    SIGIPRO Department, Simula Metropolitan Center for Digital Engineering, Oslo, Norway · SURE-AI Center, Simula Research Laboratory, Oslo, Norway · Institute of Science Tokyo, Yokohama, Japan

  25. Solving Finite-sum Coupled Compositional Optimization via Multi-block-Single-probe Estimator

    Sep 14, 2026Wei Jiang, Sifan Yang, Yibo Wang +2Stochastic OptimizationVariance Reduction

    School of Computer Science and Engineering, Nanjing University of Science and Technology, China · 2State Key Laboratory of Novel Software Technology, Nanjing University, China · School of Artificial Intelligence, Nanjing University, China

  26. Tackling Failure Modes of PINNs and PIKANs Using Conflict-Free Gradients

    Sep 13, 2026Sidharth S. Menon, Irina Tezaur, Ameya D. JagtapParametric Physics-Informed Neural NetworkGradient

    Aerospace Engineering Department, Worcester Polytechnic Institute, Worcester, MA 01609, USA. · Sandia National Laboratories, 7011 East Ave, Livermore, CA 94550, USA.

  27. RoboDrop: Curating VLA Post-Training Data via Local Gradient Compatibility

    Sep 9, 2026Runze Xu, Yuanfan Xu, Cuijie Xu +4Large-Scale Robot Demonstration DatasetsRobocasa

    Tsinghua University · Striding AI

  28. Not All Variables Agree: Reliability-Aware Variable-Wise Gradient Surgery for Multivariate Time-Series Forecasting

    Sep 8, 2026Jinwoo Park, Hyeongwon Kang, Pilsung KangMultivariate Time Series ForecastingLoss Function

    Department of Industrial Engineering Seoul National University Seoul, Republic of Korea · Department of Industrial & Management Engineering Korea University Seoul, Republic of Korea

  29. TruncGradGS: Improved 3D Gaussian Splatting via Truncated Gradient Updates

    Sep 3, 2026Theo Morales, Nhat-Quynh Le-Pham, Robin Atkins +13D Gaussian3D Gaussian Primitives

    Trinity College Dublin · Dolby Laboratories

  30. Gradients Know What Outcomes Don't: Unlocking Reinforcement Learning for LLM Reasoning with Gradient-Aligned Rewards

    Sep 3, 2026Leqi Zheng, Jinbo Su, Fang Niu +8Reinforcement Learning With Verifiable RewardLLM Reasoning Strategies

    Tsinghua University · Renmin University of China · Institute of Information Engineering, CAS +4

  31. The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA

    Sep 2, 2026Samuel LarsonLow-Rank StructureMatrix

    Pebble ML

  32. CAT-Flow: Curvature-Adaptive sTeps for Flow Matching

    Sep 1, 2026Qinchan Li, Pedro Cisneros-Velarde, Keru Fu +3Contrastive Flow MatchingGenerative Models

    Simon Fraser University · VMware Research

  33. Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC

    Sep 1, 2026Baha Zarrouki, Arslan Thobani, Jasper Hoffmann +6Offline Reinforcement LearningModel Predictive Control

  34. The Multiple Timescales of Gradient Descent on the Edge of Stability: A Perturbative Derivation of the Central Flow

    Sep 1, 2026Raphaël BerthierGradient DescentGradient

    Sorbonne Université, Inria, Centre Inria de Sorbonne Université, Paris, France

  35. Adapting Without Gradients: Affine Statistics Transport and What Its Certificate Can Tell You

    Aug 31, 2026Salim Khazem, Ibrahim Mohamed SerouisTest-Time AdaptationFrozen Backbone

    Talan Research Center · Paris, France · Toulouse, France

  36. Hard-ReLU Gradient Descent Selects an Event-Free Sensitivity Limit

    Aug 31, 2026Xiaoyang Li, Runni ZhouGradientLocal Curvature

    College of Medicine and Biological Information Engineering Northeastern University, Shenyang, China

  37. Fine-Tuning Low-Bit Models with Gradient in Quantized Code Space

    Aug 31, 2026Shiguang Wu, Zhouchen Lin, Quanming YaoModel Fine-TuningSurrogate Gradient

    Department of Electronic Engineering, Tsinghua University · School of Intelligence Science and Technology, Peking University

  38. Reciprocity Separates Gradient Flow from Rotation in Conservative Physical Learning

    Aug 31, 2026Ruiwu Niu, Xiaowen Bi, Michaël Antonie van WykWasserstein Gradient FlowsGradient

    Department of Data Science and Digital Innovation, Hong Kong Shue Yan University · Faculty of Science and Technology, Beijing Normal-Hong Kong Baptist University · School of Electrical and Information Engineering, University of the Witwatersrand, Johannesburg, South Africa

  39. GMTS: Gradient Magnitude-based Token Selection Improves RLVR Training for LLM Reasoning

    Aug 31, 2026Outongyi Lv, Yuanwei Zhang, Xiaoqun ZhangToken-Level EntropyReinforcement Learning With Verifiable Reward

    School of Mathematical Sciences, Shanghai Jiao Tong University · Institute of Natural Sciences, Shanghai Jiao Tong University

  40. Estimating Population-Risk Curves Along Nonconvex Gradient Flows from the Training Sample

    Aug 31, 2026Mingzhi SongWasserstein Gradient FlowsGradient

    Department of Mathematics, The University of Hong Kong

  41. LoRA-GA2^2: Low Rank Adaptation with Multi-step Gradient Adaptive Alignment

    Aug 20, 2026Haonan He, Xinyue FanMulti-LoraModel Fine-Tuning

    University of Science and Technology of China · Independent Researcher

  42. Activation-Keyed Momentum: An Anisotropic Momentum Update via the Delta Rule

    Aug 19, 2026Euijin Hong, Guannan QuMomentum Stochastic Gradient DescentMomentum

    Electrical and Computer Engineering, Carnegie Mellon University

  43. Fine-Tuning Generative Models for Extreme Events via CVaR-Penalized Wasserstein Gradient Flows

    Aug 12, 2026Thejani Gamage, Hyemin Gu, Zhizhen Zhang +3Long-Tailed DistributionWasserstein Gradient Flows

    Department of Mathematics and Statistics, University of Massachusetts Amherst, Amherst, MA · School of Data and Information Sciences (SDIS) and Department of Mathematics, University of North Carolina at Chapel Hill, Chapel Hill, NC

  44. Convergence Guarantees of Gradient Descent for Neural Networks via Generalized Lipschitz Smoothness

    Aug 11, 2026Siqiao Mu, Diego KlabjanGradient DescentLipschitz Continuity

  45. Learning Gaussian Structure: Intervention-Guided Density Control for Feed-Forward Driving Reconstruction

    Aug 11, 2026Hang Li, Jiahe Li, Meiying Gu +3Feed-Forward 3D GaussianGaussian Primitives

    School of Computer Science and Engineering, Beihang University · State Key Laboratory of Software Development Environment, Jiangxi Research Institute, Beihang University · State Key Laboratory of Virtual Reality Technology and System, Beihang University +1

  46. Why Post-Norm Transformers Collapse: Attention Amplification and Gradient Repair Failure

    Aug 10, 2026Xingjian Wang, Qingyu Han, Xiaodong Luo +1Batch NormalizationTransformer Encoder

    The Chinese University of Hong Kong, Shenzhen · Shenzhen Research Institute of Big Data

  47. Gradient Under Microscope: Benchmarking Resource Utilization of Memory-Efficient Gradient Computation Methods

    Aug 9, 2026Sarthak Mahapatra, Zihan Zhou, Khatoon Khedri +2GradientAdam

  48. Density-Functional Excited-State Gradients and Nonadiabatic Couplings on a Consumer GPU from a Contraction-DAG

    Aug 6, 2026Rubén Darío GuerreroDensity Functional TheorySingle Excitation Time History

    NeuroTechNet S.A.S., 1108831, Bogot´a, Colombia · Quantum and Computational Chemistry Group (QCCG), Universidad Nacional de Colombia, Bogot´a, Colombia

  49. The Loss Does Not See the Basis, but Adam Does

    Aug 5, 2026Devender SinghLow-Rank StructureAdam

    Department of Computer Science Memorial University of Newfoundland

  50. When does training on downscaled images yield the same gradients?

    Aug 5, 2026Seunghyun JiDiffusion TransformersGradient

    Independent researcher

  51. Hard Constraints, Smooth Gradients: Learning Feasible Inventory Policies via Differentiable Projection

    Aug 3, 2026Patrick Helm, Jan-Niklas Doerr, Joren Gijsbrechts +1Mixed-Integer ProgrammingInequality Constraints

    TUM School of Management, Technical University of Munich · Esade, Ramon Llull University · Munich Data Science Institute (MDSI), Technical University of Munich

  52. Generalized Quadratic Gradient: A New Direction in Optimization via the Fusion of Positive-Definite Curvature Matrices and Gradients into A Unified Framework

    Aug 3, 2026John ChiangHessianNewton

  53. Adaptivity via a Parallel Architecture for Stochastic Gradient Methods

    Jul 31, 2026Bin FuStochastic Gradient DescentGradient Descent

    University of Texas Rio Grande Valley

  54. QQWorld: Quantile-Quantile Matching for World Model Regularization

    Jul 30, 2026Zhoushun Yu, Xiaoyu Hu, Xiangyu XuLatent World ModelsEfficient Planning

    Xi’an Jiaotong University

  55. LoRA Scaffolded Policy Optimization (LSPO): A Sampling-Time Low-Rank Scaffold for Recovering Reinforcement-Learning Gradient on Zero-Reward Cliff Prompts

    Jul 30, 2026Ken DingReinforcement Learning With Verifiable RewardFrictive Policy Optimization

    NVIDIA

  56. Between Gradient and Natural Gradient: A Continuum of LoRA Initializations

    Jul 28, 2026Dianze Liu, Farshid GhezelbashModel Fine-TuningGradient

    Georgia Institute of Technology

  57. Geometry Meets Semantics: Fractional Gradient Stabilization for Semantic-Driven Bounding Box Optimization in Visual Detection Tasks

    Jul 26, 2026Qi Ming, Zheng Zhou, Haitian Yang +4Bounding BoxGeometric Machine Learning

    Beijing University of Technology · ShanghaiTech University · Beijing Institute of Technology +3

  58. Mini-batch Noise Lowers Sharpness via Dominant-Subspace Fluctuations

    Jul 25, 2026Junho So, Dongwook ShinStochastic Gradient DescentSharpness-Aware Minimization

    Department of Mathematics, Ajou University, South Korea

  59. Finite-Time Analysis of the Natural Policy Gradient in Finite-Horizon Markov Decision Processes

    Jul 25, 2026Asha Barua, Sajad KhodadadianPolicy GradientMarkov Decision Processes

    Grado Department of Industrial and Systems Engineering, Virginia Polytechnic Institute and State University, Blacksburg, Virginia 24061, USA.

  60. Pipelined Gradient Coding

    Jul 22, 2026Xian Su, Jun LiPartitioningGradient

    Department of Computer Science · Florida International University · Miami, FL, USA +3