Temporal Difference

Ask about this topic

Momentum

6 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 41

All topics
CardsList

  1. Temporal-Difference Learning for Dragonchess

    Oct 1, 2026Jim O'Connor, Annika Hoag, Sarah Goyette +1ChessTemporal Difference

    Connecticut College, New London CT 06320, USA

  2. Fast Regularized Policy Mirror Descent with One-Step TD Updates

    Sep 30, 2026Qipei Chen, Wenye Li, Yule Sun +1Mirror DescentTemporal Difference

    School of Mathematical Sciences, Fudan University · School of Data Science, Fudan University

  3. Sharp Statistical Rates for Asynchronous TD Learning with Markovian Data

    Sep 30, 2026Yang PengTemporal DifferenceMarkov

    Yau Mathematical Sciences Center, Tsinghua University

  4. GTRL: Grounding Divide-and-Conquer Value Learning with Temporal Differences

    Sep 27, 2026Abdul Monaf Chowdhury, MD Sameer Iqbal Chowdhury, Shifat E Arman +1Goal-Conditioned Reinforcement LearningTemporal Difference

    Department of Robotics and Mechatronics Engineering, University of Dhaka, Bangladesh · Department of Computer Science, Texas State University, USA · Department of Computer Science, University of Oxford, UK

  5. A Contraction Framework for Stochastic Operators with Bootstrapping: Application to TD Learning

    Sep 24, 2026Ids van der Werf, Sergio Rozada, Antonio G. MarquesStochastic ApproximationTemporal Difference

    Delft University of Technology, Dep. Microelectronics, Delft, The Netherlands

  6. CARE-VI: Conservative Adaptive Reliability Estimation for Value Improvement in Off-Policy Actor-Critic Learning

    Sep 17, 2026Xiang Zou, Shengzhu Shi, Junqi Gao +1Soft Actor-CriticTemporal Difference

    School of Mathematics, Harbin Institute of Technology, Harbin 150001, China

  7. Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC

    Sep 1, 2026Baha Zarrouki, Arslan Thobani, Jasper Hoffmann +6Offline Reinforcement LearningModel Predictive Control

  8. A Finite-Sample Analysis of Quantile Temporal-Difference Learning

    Aug 27, 2026Zijie Cheng, Xiang Li, Yang Peng +1Temporal DifferenceConvergence

    School of Mathematical Sciences, Peking University · Perelman School of Medicine, University of Pennsylvania · Yau Mathematical Sciences Center, Tsinghua University

  9. Online Inference for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

    Aug 13, 2026Zijie Cheng, Yang Peng, Zhihua ZhangDistributional Reinforcement LearningTemporal Difference

    School of Mathematical Sciences, Peking University · Yau Mathematical Sciences Center, Tsinghua University

  10. Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling

    Aug 11, 2026Min Zeng, Yichen Zhang, Xiaofeng ShaoTemporal DifferenceLarge Deviation Principle

    Department of Biostatistics, City University of Hong Kong, Hong Kong SAR, China · Department of Quantitative Methods, Purdue University, West Lafayette, Indiana, USA · Department of Statistics and Data Science, Washington University in St. Louis, St. Louis, Missouri, USA +1

  11. Gated-BEPO: Confidence-Gated Bellman Credit Assignment for Large Language Model Agents

    Aug 7, 2026Hongxi Yan, Ziyue Huang, Shichao Fan +1Credit AssignmentLarge Language Model Agents

    State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China · Zhongguancun Laboratory, Beijing, China · Qualcomm, Beijing, China

  12. Visual Representation Matters: Exploiting Temporal Differences in Video-to-Audio Generation

    Aug 5, 2026Zehua Chen, Junyou Wang, Yuxuan Jiang +5Audio-Video GenerationText-To-Video Diffusion Models

    Tsinghua University, Beijing, China · Hefei University of Technology, Hefei, China · Monash University, Australia +1

  13. Revisiting TD Target Aggregation under Uncertainty in Q-Learning

    Aug 4, 2026Lipeng Zu, Xiaonan ZhangDeep Q-NetworksQ-Learning

    Computer Science Department, Florida State University, Tallahassee, Florida, USA

  14. Generalized Kalman filter based temporal difference reinforcement learning

    Jul 22, 2026Vasos Arnaoutis, Eric Lutters, Bojana RosićTemporal DifferenceExtended Kalman Filter

    Applied Mechanics and Data Analysis, Faculty of Engineering Technology, University of Twente, Enschede, the Netherlands · Department of Design, Production and Management, Faculty of Engineering Technology, University of Twente, Enschede, the Netherlands · Digital Engineering research group, Faculty of Mechanical and Industrial Engineering, Vienna University of Technology, Vienna, Austria

  15. Non-Convex Sparse Reinforcement Learning via Non-Monotone Inclusions

    Jul 6, 2026Kyohei Suzuki, Konstantinos SlavakisEntropy Regularized Reinforcement LearningLipschitz Continuity

    Department of Information and Communications Engineering, Institute of Science Tokyo, Yokohama, 226-8501, Japan

  16. Mesh-RL: Coupled subgrid reinforcement learning

    Jun 24, 2026Behnam Gheshlaghi, Bahador Rashidi, Shahin AtakishiyevTemporal DifferenceQ-Learning

    Independent Researcher · University of Alberta

  17. A Single Stepsize Suffices for Unprojected Linear TD(0): Simultaneous Robust and Fast Rates via Polyak--Ruppert Averaging

    Jun 23, 2026Wei-Cheng Lee, Francesco OrabonaStep AccuracyTemporal Difference

    King Abdullah University of Science and Technology (KAUST) Thuwal, 23955-6900, Kingdom of Saudi Arabia

  18. On the Variance of Temporal Difference Learning and its Reduction Using Control Variates

    Jun 18, 2026Hsiao-Ru Pan, Bernhard SchölkopfTemporal DifferenceVariance Reduction

    Max Planck Institute for Intelligent Systems, Tübingen · ELLIS Institute Tübingen · ETH Zürich

  19. A Diffusion Approximation for Temporal-Difference Learning with Linear Features under Markovian Noise

    Jun 16, 2026M. Forzo, E. Monzio Compagnoni, A. Russo +1Temporal DifferenceStochastic Differential Equations

    Technical University of Munich (TUM), Munich, Germany · University of Basel, Basel, Switzerland · Boston University, Boston, USA.

  20. You Don't Need Strong Assumptions: Visual Representation Learning via Temporal Differences

    Jun 14, 2026Ninad Daithankar, Alexi Gladstone, Yann LeCun +1Self-Supervised RepresentationsPhotometric Supervision

    1UIUC · 2New York University

  21. Temporal Difference Learning for Diffusion Models

    Jun 13, 2026Qizhen Ying, Yangchen Pan, Victor Adrian Prisacariu +1Denoising TrajectoryGenerative Models

    Department of Engineering Science, University of Oxford, Oxford, United Kingdom · School of Computer Science, Carleton University, Ottawa, Canada.

  22. QPILOTS: Efficient Test-Time Q-Steering for Flow Policies

    Jun 11, 2026Yifan Ruan, Chenyang Cao, Andreas Burger +7Flow PoliciesQ-Learning

    University of Toronto · Vector Institute · LG Electronics

  23. Fast and Robust Convergence Rate for TD(0) with Linear Function Approximation, Universal Learning Steps and I.I.D. Samples

    Jun 4, 2026Ziad Kobeissi, Éloïse BerthierTemporal DifferenceConvergence

    L2S · L2S, INRIA Université Paris-Saclay, CentraleSupelec, Gif-sur-Yvette, France · U2IS +1

  24. GRAIL: Gradient-Reweighted Advantages for Reinforcement Learning with Verifiable Rewards

    Jun 3, 2026Tej Deep Pala, Vernon Toh, Soujanya PoriaReinforcement Learning With Verifiable RewardVerifiable Rewards

    DeCLaRe Lab, Nanyang Technological University

  25. Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning

    May 29, 2026Vagul Mahadevan, Claire Chen, Shuze Daniel Liu +1Stochastic ApproximationTemporal Difference

    Metron, Reston, VA, USA · Division Office Physics, Math and Astronomy, California Institute of Technology, Pasadena, CA, USA · Data Science Lab, MIT, Cambridge, MA, USA +2

  26. ST-SimDiff: Balancing Spatiotemporal Similarity and Difference for Efficient Video Understanding with MLLMs

    May 21, 2026Bingjun Luo, Tony Wang, Chaoqi Chen +1Fine-Grained Video UnderstandingVideo Understanding

    Tsinghua University · Shenzhen University · Xidian University

  27. Guided Trajectory Optimization with Sparse Scaling for Test-Time Diffusion

    May 21, 2026Gang Dai, Yining Huang, Yiming Xia +2Diffusion ModelsTest-Time Scaling

    Guangdong University of Technology · South China University of Technology · Nanyang Technological University

  28. Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction

    May 17, 2026Xingguo Chen, Zhiang He, Yuchen Shen +4Temporal DifferenceOff-Policy Learning

    Nanjing University of Posts and Telecommunications, Nanjing, China · Department of Computer Science and Technology, Nanjing University, Nanjing, China · College of Electronic Countermeasure, National University of Defense Technology, Hefei, China

  29. Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction

    May 16, 2026Xingguo Chen, Yuchen Shen, Shangdong Yang +3Temporal DifferenceMirror Descent

    Nanjing University of Posts and Telecommunications, Nanjing, China · Department of Computer Science and Technology, Nanjing University, Nanjing, China · College of Electronic Countermeasure, National University of Defense Technology, Hefei, China

  30. The Benefits of Temporal Correlations: SGD Learns k-Juntas from Random Walks Efficiently

    May 11, 2026Elisabetta Cornacchia, Dan Mikulincer, Elchanan MosselStochastic Gradient DescentOptimal Sample Complexity

    1Bocconi University · University of Washington (UW). · 3Massachusetts Institute of Technology (MIT).

  31. One for All: A Non-Linear Transformer can Enable Cross-Domain Generalization for In-Context Reinforcement Learning

    May 10, 2026Bowen He, Juncheng Dong, Lin Lin +1In-Context LearningTransformer Architectures

    Duke University, Durham, U.S.A.

  32. Equivalence of Coarse and Fine-Grained Models for Learning with Distribution Shift

    May 7, 2026Adam R. Klivans, Shyamal Patel, Konstantinos Stavropoulos +1LearnabilityDistribution Shifts

    UT Austin · Columbia University

  33. On the Divergence of Differential Temporal Difference Learning without Local Clocks

    May 7, 2026David Antrobius, Shangtong ZhangTemporal DifferenceClocks

    Department of Computer Science University of Virginia

  34. A Finite-Iteration Theory for Asynchronous Categorical Distributional Temporal-Difference Learning

    May 7, 2026Ege C. Kaya, Abolfazl HashemiTemporal DifferenceDistributional Reinforcement Learning

    Elmore Family School of Electrical and Computer Engineering Purdue University West Lafayette, IN 47906

  35. Extending Differential Temporal Difference Methods for Episodic Problems

    May 6, 2026Kris De Asis, Mohamed Elsayed, Jiamin HeTemporal DifferenceEpisodic Memory

    1Openmind Research Institute · Department of Computing Science, University of Alberta, Canada · 3Alberta Machine Intelligence Institute (Amii)

  36. Structural Equivalence and Learning Dynamics in Delayed MARL

    May 5, 2026Jules Sintes, Ana Bušić, Jiamin ZhuPartially Observable Markov Decision ProcessMulti-Agent Reinforcement Learning

    Inria · DIENS, École Normale Supérieure, PSL University · Paris, France +2

  37. Bridging the Gap Between Average and Discounted TD Learning

    May 3, 2026Haoxing Tian, Zaiwei Chen, Ioannis Ch. Paschalidis +1Temporal DifferenceBellman Equation

    Department of Electrical and Computer Engineering Boston University · Edwardson School of Industrial Engineering Purdue University

  38. Regularized Centered Emphatic Temporal Difference Learning

    May 2, 2026Xingguo Chen, Chaohui Wu, Jinguo Ye +5Temporal DifferenceRegularization

    Nanjing University of Posts and Telecommunications · Nanjing University · Microsoft +1

  39. Temporal Difference Calibration in Sequential Tasks: Application to Vision-Language-Action Models

    Apr 22, 2026Shelly Francis-Meretzki, Mirco Mutti, Yaniv Romano +1Temporal DifferencePhotometric Supervision

    1Technion - Israel Institute of Technology.

  40. Learnability Window in Gated Recurrent Neural Networks

    Dec 5, 2025Lorenzo LiviRecurrent Neural NetworksLearnability

    OPIT – Open Institute of Technology

  41. Statistical Inference for Policy Evaluation with Temporal Difference Learning

    Oct 21, 2024Weichen Wu, Gen Li, Yuting Wei +1Temporal DifferenceValue Functions

    The Voleon Group, New York, NY, USA · Department of Statistics, The Chinese University of Hong Kong, Hong Kong SAR. · Department of Statistics and Data Science, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA. +1