Soft Actor-Critic

Ask about this topic

Momentum

13 papers in the last four weeks, up 63% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 106

All topics
CardsList

  1. Trust the Critic More

    Sep 30, 2026Kaiyue Wen, Luke Bailey, Arvind Mahankali +1Critic-Free Reinforcement LearningLarge Language Model Reinforcement Learning

    Stanford University

  2. DAMPER: Return-Prioritized Gradient Control for Smooth Policies

    Sep 30, 2026Seokmin Ko, Taewon Goo, Kihyuk HongSoft Actor-CriticPolicy Gradient

    KAIST

  3. Privy to the Foil: Recasting Value Estimation with a Self-Privileged Critic for RLVR

    Sep 29, 2026Kun Liang, Chenming Tang, Clive Bai +5Reinforcement Learning With Verifiable RewardSoft Actor-Critic

    School of Computer Science, Peking University · National Key Laboratory for Multimedia Information Processing, Peking University · Foundation Model Department, Tencent

  4. Action Chunking Proximal Policy Optimization with Feedback Correction

    Sep 28, 2026Sanghyun Hahn, Jonghyun ChoiAction ChunksProximal Policy Optimization

    Cornell University · Seoul National University

  5. An analysis of Mirror-Descent Soft Actor-Critic

    Sep 28, 2026Denis Zorba, Michal ValkoMirror DescentSoft Actor-Critic

    School of Mathematics, University of Edinburgh, United Kingdom · INRIA, Paris, France

  6. Verifying Neural Networks with Reinforcement Learning

    Sep 28, 2026Hai Duong, Thanh Le, ThanhVu NguyenNeural Network VerificationReinforcement Learning With Verifiable Reward

    Department of Computer Science George Mason University Fairfax, VA, USA · Unaffiliated Yokosuka, Japan

  7. A Concentration Bound for Two-Timescale Actor-Critic Algorithm

    Sep 24, 2026Prashansa Panda, Shalabh BhatnagarSoft Actor-CriticFinite Time Analysis

    Department of Computer Science and Automation IISc Bangalore

  8. PACT: From Credit Assignment to Critic Alignment

    Sep 22, 2026Jiayan Fu, Hang Xu, Yong Zhang +4Critic-Free Reinforcement LearningCredit Assignment

    AllSpark Team

  9. CARE-VI: Conservative Adaptive Reliability Estimation for Value Improvement in Off-Policy Actor-Critic Learning

    Sep 17, 2026Xiang Zou, Shengzhu Shi, Junqi Gao +1Soft Actor-CriticTemporal Difference

    School of Mathematics, Harbin Institute of Technology, Harbin 150001, China

  10. GR2PO: Group Relative Return Policy Optimization for Continuous Robot Control

    Sep 17, 2026Pengqin Wang, Qiming Zhang, Shaojie Shen +1Robot PoliciesSoft Actor-Critic

    Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Division of Emerging Interdisciplinary Areas, the Hong Kong University of Science and Technology, Hong Kong SAR, China · Intelligent Transportation Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China +1

  11. Prior Evolution and Task Alignment for Aerial Grasping

    Sep 16, 2026Weiliang Deng, Zhengyang Dang, Yao Mu +1Robotic GraspingAerial Manipulation

    School of Intelligent Systems Engineering, Sun Yat-sen University, Guangzhou 510275, China · AI Institute, School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China · Differential Robotics Technology Co., Ltd., Hangzhou, China

  12. Unthrottling the Tanh Jacobian in SAC: A Negative Result on Bang-Bang Control and MetaDrive

    Sep 8, 2026Faiq ShamassSoft Actor-CriticJacobian

    Independent Researcher

  13. AlphaRJM: Reward-Jump Memory for Stochastic Return-Guided Alpha Discovery

    Sep 8, 2026Sayan Dhan, Selvaraju NatarajanSoft Actor-CriticStochastic

    Department of Mathematics Indian Institute of Technology Guwahati

  14. A Channel-Boosted Multi-Agent System with Iterative Consultation for Document Sensitivity Classification

    Sep 2, 2026Aleesha Zainab, Asifullah Khan, Muhammad Ahmed Khalid +1Large Language Model ClassificationLog-Ratio-Based Gaussian Trust Weight

    Pattern Recognition Lab, Department of Computer and Information Sciences (DCIS), Pakistan Institute of Engineering and Applied Sciences (PIEAS), Nilore, Islamabad, Pakistan. · Deep Learning Lab, Center for Mathematical Sciences, Pakistan Institute of Engineering and Applied Sciences (PIEAS), Nilore, Islamabad, Pakistan. · PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering and Applied Sciences (PIEAS), Nilore, Islamabad, Pakistan.

  15. Locally-Guided Actor-Critic: Training a Goal-conditioned Actor with a Subgoal-aware Critic

    Aug 31, 2026Olivier Serris, Stéphane Doncieux, Olivier SigaudGoal-Conditioned Reinforcement LearningPotential-Based Reward Shaping

    ISIR · Sorbonne Université, CNRS

  16. Co-Evolving Actor-Conditioned Critics for Non-Verifiable Generation

    Aug 31, 2026Jinyoung Kim, Muhammad Khalifa, Lajanugen Logeswaran +4CritiqueCritic

    University of Michigan · LG AI Research · University of Illinois at Chicago

  17. Graph Neural Assisted Actor-Critic for Latency-Efficient Edge Vision System

    Aug 17, 2026Alam Noor, Luis Almeida, Kai Li +3Unmanned Aerial VehiclesVision Sensors

    CISTER Research Center, Porto, Portugal. · Instituto de Telecomunicac¸˜oes, Faculdade de Engenharia, Universidade do Porto, Portugal. · Department of Information Technology, Kennesaw State University, USA. +2

  18. S2-HWM: Sparse Event-Structured Hierarchical World Model for Long-Horizon Surgical Robot Manipulation

    Aug 13, 2026Shuzhe Zhang, Xin Zhu, Yinling Qian +1Efficient World-Action ModelWorld Models

    Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences

  19. Contextual Quality-Diversity Evolutionary Reinforcement Learning for HVAC Control in Tropical Commercial Buildings

    Aug 11, 2026Tran Le VuHvac ControlReinforcement Learning Control

  20. Critic-Free Pretraining for Efficient Online Reinforcement Learning Fine-Tuning

    Aug 11, 2026Daoyi Li, Yixian Zhang, Wenbo Ding +2Soft Actor-CriticBoltzmann Policies

    Tsinghua University

  21. Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control

    Aug 10, 2026Faizan Ahmed, Aniket Dixit, James BruseyHvac ControlSoft Actor-Critic

    Centre for Computational Science and Mathematical Modelling, Coventry University, United Kingdom

  22. V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control

    Aug 8, 2026Donghu Kim, Youngdo Lee, Hojoon Lee +6Simulation-Based Reinforcement LearningScalable Robot Learning

    KAIST · Mila – Québec AI Institute · Université de Montréal +2

  23. Learning Suffers More Than the Policy Class Under Partial Observability: A Closed-Form Analysis

    Aug 7, 2026Idil GözelSoft Actor-CriticOffline Reinforcement Learning

    University College London · Department of Physics and Astronomy University College London, London, UK

  24. Toward Integrating Adaptive Experience Replay and Online Uncertainty Estimation in Safe Actor-Critic Optimal Control

    Aug 5, 2026Mahshad Rastegarmoghaddam, Davoud Nikkhouy, Shima SamadzadehControl Barrier FunctionsSoft Actor-Critic

    Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy

  25. Foundations of Reinforcement Learning and Control:Connections and New Perspectives

    Aug 3, 2026Claire Vernade, Onno Eberhard, Martha White +4Adaptive ControlSoft Actor-Critic

    University of Technology Nuremberg · Max Planck Institute for Intelligent Systems, Tübingen, Germany · University of Alberta and Alberta Machine Intelligence Institute (Amii) +2

  26. ReBRAC-v2: The Return of the King

    Aug 2, 2026Denis Tarasov, Robert K. KatzschmannModel-Based Reinforcement LearningSoft Actor-Critic

    Soft Robotics Lab, D-MAVT ETH Zurich, Switzerland

  27. Hierarchical Multilevel Monte Carlo for Order-Optimal Neural Actor-Critic in Average-Reward CMDPs

    Jul 30, 2026Ankur Naskar, Vaneet AggarwalSoft Actor-CriticMarkov Decision Processes

    Indian Institute of Science, India · Purdue University, USA

  28. Collaborative Weighting with Pessimistic Critic for Mitigating Overestimation in Off-Policy Reinforcement Learning

    Jul 29, 2026Gong Gao, Xiao Lai, Ziqi Xie +3Soft Actor-CriticPessimism

    School of Computer Science and Technology, Tongji University, 200092, Shanghai, China · Shanghai University of Engineering Science, 201620, Shanghai, China

  29. Shared Voxel-Map-Based Cooperative Indoor UAV Guidance with a Multi-Agent Soft Actor-Critic Controller

    Jul 28, 2026Thomas Hickling, Dylan Wynne, Yu Su +1Multi-UavUnmanned Aerial Vehicles

    School of Science and Technology City St George’s University of London London, United Kingdom

  30. Hierarchical Soft Actor-Critic for Sparse-Reward Long-Horizon Reinforcement Learning

    Jul 26, 2026Zahra Abdalla Elashaal, Afef Hfaiedh, Nahla Khraief +2Hierarchical Reinforcement LearningEntropy Regularized Reinforcement Learning

    Lab. of Robotics, Informatics and Complex Systems, National Engineering School of Tunis, University of Tunis El Manar, Tunis, Tunisia · Faculty of Information Technology, University of Tripoli, Tripoli, Libya · Lab. of Robotics, Informaticsand Complex Systems, National Engineering School of Tunis, University of Tunis El Manar, Tunis, Tunisia +3

  31. Deep Reinforcement-Learning-Guided Model Predictive Control for Preventing Overtakes in Autonomous Racing

    Jul 23, 2026Yufei Xi, Yijie Liao, Tulga ErsalAutonomous RacingModel Predictive Control

    Department of Mechanical Engineering, College of Engineering, University of Michigan, Ann Arbor, MI, USA. · Department of Electrical Engineering and Computer Science, College of Engineering, University of Michigan, Ann Arbor, MI, USA. · School of Computing, National University of Singapore, Singapore.

  32. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning

    Jul 21, 2026Ubayd Ali Bapoo, Clement N NyirendaMulti-Agent Reinforcement LearningSoft Actor-Critic

    Department of Computer Science University of the Western Cape Cape Town, South Africa

  33. Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners

    Jul 14, 2026Haseeb Shah, Lingwei Zhu, Adam White +1Soft Actor-CriticGaussian Primitives

    Department of Computing Science, University of Alberta, Canada · Alberta Machine Intelligence Institute (amii), Canada · Great Bay University, China +1

  34. Actor-Critic Learning for Extended Mean Field Control with Deterministic Policies

    Jul 13, 2026Ziheng Cheng, Xin Guo, Huyên Pham +1Stochastic Optimal ControlModel-Free Reinforcement Learning

    University of California, Berkeley · Ecole Polytechnique, CMAP · Imperial College London

  35. PAC-ACT: Post-training Actor-Critic for Action Chunking Transformers

    Jul 10, 2026Yujie Pang, Zudong LiAction ChunksSoft Actor-Critic

    Dept. of Mechanical and Energy Engineering · Southern University of Science and Technology · Shenzhen, China

  36. Adaptive Reparametrized Time for Score-Based Diffusion Sampling

    Jul 2, 2026Yilie Huang, Wenpin Tang, Xun Yu ZhouDiffusion SamplingTimestep

    Department of Applied Mathematics, The Hong Kong Polytechnic University, Hong Kong. · Department of Industrial Engineering and Operations Research, Columbia University, New York, NY 10027, USA. · Department of Industrial Engineering and Operations Research and Data Science Institute, Columbia University, New York, NY 10027, USA.

  37. Learning the Supports for Categorical Critic in Reinforcement Learning

    Jul 2, 2026Jen-Yen Chang, Takayuki Osa, Tatsuya HaradaSoft Actor-CriticValue Functions

    Graduate School of Information Science and Technology, The University of Tokyo · RIKEN AIP

  38. Gauging, Measuring, and Controlling Critic Complexity in Actor-Critic Reinforcement Learning

    Jul 1, 2026Konstantin GarbersSoft Actor-CriticCritic

    Peking University

  39. FastDSAC: Enhancing Policy Plasticity via Constrained Exploration for Scalable Humanoid Locomotion

    Jun 30, 2026Guanchen Lu, Yajuan Dun, Yi Zhou +4Soft Actor-CriticOffline Reinforcement Learning

    Chongqing University, Chongqing 400044, China · Ministry of Industry and Information Technology, Beijing 100804, China · Tsinghua University, Beijing 100084, China +1

  40. Dual-Flow Reinforcement Learning with State-Aware Exploration

    Jun 29, 2026Qijun Li, Zheng Fu, Qi Song +4Multimodal Action DistributionsSoft Actor-Critic

    School of Vehicle and Mobility and the State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing 100084, China

  41. PS-PPO: Prefix-Sampling PPO for Critic-Free RLHF

    Jun 29, 2026Doo Hwan Hwang, Kee-Eung KimReinforcement Learning From Human FeedbackCritic-Free Reinforcement Learning

    Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea.

  42. BV-Blend: Uncertainty-Weighted Historical Baselines for Stable Critic-Free RL with Verifiable Rewards

    Jun 27, 2026Yupeng Chang, Yuan Wu, Yi ChangReinforcement Learning With Verifiable RewardCritic-Free Reinforcement Learning

    School of Artificial Intelligence, Jilin University · 2Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China · 3International Center of Future Science, Jilin University

  43. Revisiting Action Factorization for Complex Action Spaces

    Jun 25, 2026Timothy Flavin, Sandip SenAction SpaceSoft Actor-Critic

    The University of Tulsa, Tulsa, Oklahoma, USA

  44. EVOM: Agentic Meta-Evolution of Actor-Critic Architectures for Reinforcement Learning

    Jun 24, 2026Boyun Zhang, Chao Wang, Kai WuOn-Policy Self-EvolutionSoft Actor-Critic

    Xidian University

  45. WaveForward: An Omnidirectional Passive Wheeled Quadruped Robot with Casters

    Jun 24, 2026Chuanlin Zhao, Qifeng Zheng, Shuhan Wang +3Legged RobotsPassive

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China

  46. Bias-Controlled Primal-Dual Natural Actor-Critic: Optimal Rates for Constrained Multi-Objective Average-Reward RL

    Jun 23, 2026Ankur Naskar, Swetha Ganesh, Vaneet AggarwalMulti-Objective Reinforcement LearningSoft Actor-Critic

    Indian Institute of Science, Bengaluru, India · Purdue University, USA

  47. VisCritic: Visual State Comparison as Process Reward for GUI Agents

    Jun 23, 2026Jiachen QianGraphical User Interface AgentsSoft Actor-Critic

    City University of Hong Kong

  48. CKM-Driven Communication-Aware UAV Intelligent Trajectory Optimization for Urban Inspection

    Jun 23, 2026Yang Xiaomeng, Jia Ziye, Zhu Qiuming +1Unmanned Aerial Vehicle TrajectoriesUnmanned Aerial Vehicles

    The Key Laboratory of Dynamic Cognitive System of Electromagnetic Spectrum Space, Ministry of Industry and Information Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, 211106, China

  49. FlowDPG: Deterministic Policy Gradient on Flow Matching Policies for Real-World Manipulation

    Jun 21, 2026Kexin Shi, Junyao Shi, Poorvi Hebbar +5Flow PoliciesRobotic Manipulation Policies

    Skild AI · Carnegie Mellon University · University of Pennsylvania

  50. A Test-time Actor-Critic Approach to News Images Generation

    Jun 19, 2026Damianos Galanopoulos, Vasileios MezarisImage GenerationSoft Actor-Critic

    Information Technologies Institute (ITI), Centre of Research and Technology Hellas (CERTH), Thessaloniki, Greece

  51. Multi-Head Attention-Based Feature Extractor Integration with Soft Actor-Critic for Porosity Prediction and Process Parameter Optimization in Additive Manufacturing

    Jun 18, 2026Kianoush Aqabakee, Leonardo StellaSoft Actor-CriticPorous Media

    Department of Electrical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran, and Department of Mechanical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran · School of Computer Science, University of Birmingham, Birmingham B15 2TT, United Kingdom

  52. SWAP: Symmetric Equivariant World-Model for Agile Robot Parkour

    Jun 18, 2026Kaixin Lan, Ze Wang, Hongyi Li +6Scalable Robot LearningWorld Models

    Center for X-Mechanics, Zhejiang University, Hangzhou, China · Mirrorme Technology Co., Ltd. Shanghai, China · ZJU-Hangzhou Global Scientific and Technology Innovation Center, Hangzhou, China

  53. When Does Trajectory-Level Supervision Permit Efficient Offline Reinforcement Learning?

    Jun 16, 2026Xuanfei Ren, Tengyang XieModel-Based Reinforcement LearningOffline Reinforcement Learning

    University of Wisconsin-Madison · Madison, WI

  54. Phi-Actor-Critic: Steering General-Sum Games to Pareto-Efficient Correlated Equilibria

    Jun 9, 2026Wongyu Lee, Francesco Lelli, Omran Ayoub +1Multi-Agent Reinforcement LearningSoft Actor-Critic

    Politecnico di Milano · Tilburg University · University of Applied Sciences and Arts of Southern Switzerland

  55. Mitigating Bias in Low-SNR Financial Reinforcement Learning via Quantum Representations

    Jun 9, 2026Zeyu Liu, Xuanzhi Feng, Sing Kwong Lai +6Soft Actor-CriticOffline Reinforcement Learning

    The Hong Kong University of Science and Technology

  56. Structure-Conditioned Actor-Critic Branches for Quality-Diversity Reinforcement Learning

    Jun 7, 2026Lianrong Zuo, Peilan Xu, Yong Liu +1Soft Actor-Critic

    Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies, Institute of Cyberspace Security, School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen 518055, Guangdong, China

  57. TT-DAC-PS: Twin-Target Deterministic Actor-Critic with Policy Smoothing for Optimal Trade Execution

    Jun 7, 2026Ilia Zaznov, Atta Badii, Julian Kunkel +1Soft Actor-CriticExponential Moving Average

    Department of Computer Science University of Reading Reading, UK · Department of Computer Science/GWDG University of Göttingen Goettingen, Germany · ICMA Centre, Henley Business School University of Reading Reading, UK

  58. Retry Policy Gradients in Continuous Action Spaces

    Jun 4, 2026Soichiro Nishimori, Paavo ParmasSoft Actor-CriticRetrying

    The University of Tokyo, Japan

  59. Representation Learning Enables Scalable Multitask Deep Reinforcement Learning

    Jun 4, 2026Johan Obando-Ceron, Lu Li, Scott Fujimoto +3Multi-Turn Reinforcement LearningModel-Based Reinforcement Learning

    Mila – Québec AI Institute · Université de Montréal · McGill University +2

  60. From Ticks to Flows: Dynamics of Neural Reinforcement Learning in Continuous Environments

    Jun 2, 2026Saket Tiwari, Tejas Kotwal, George KonidarisSoft Actor-CriticOffline Reinforcement Learning

    Department of Computer Science Brown University · Department of Applied Mathematics Brown University