Soft Actor-Critic

Also known as SAC

Overview

Soft Actor-Critic (SAC) learns continuous actions by combining reward with an entropy bonus, encouraging exploration, while replay buffers and twin critics support sample-efficient off-policy training. Research builds on this core with distributional critics, ensembles, hierarchical policies, safety constraints, and guidance to improve value estimates, exploration, and long-horizon planning. SAC is studied in settings including robotic locomotion and manipulation, building control, and autonomous driving, with sim-to-real transfer an important goal. A central tension is improving data efficiency and scaling to complex tasks without unstable or overestimated critics, while choosing enough exploration to learn useful behavior.

Latest papers

CardsList

31 papers2 papers in the last four weeks, down 60% on the four weeks before. 0.0% of all new papers.

  1. Can Hindsight Critics Guide Delayed Actors?

    Nov 9, 2026Francisco M. López, Francisco CruzDelayed RLPartially Observable RL

  2. Revisiting Critic Estimation in Soft Actor-Critic Algorithms

    Nov 3, 2026Jan Felix Kleuker, Koen Ponse, Aske Plaat +1Reinforcement LearningSoft Actor-Critic

  3. Large language model and reinforcement learning based autonomous construction and progress updates

    Oct 16, 2026Yifei Xiao, Huasheng Lin, T. Y. YangRobotic ConstructionReinforcement Learning

  4. A Geometric Approach to Soft Actor-Critic with Zonotopes for Locomotion Learning

    Oct 8, 2026Panagiotis Roditis, Panagiotis P. Filntisis, Petros MaragosReinforcement LearningSoft Actor-Critic

  5. An analysis of Mirror-Descent Soft Actor-Critic

    Sep 28, 2026Denis Zorba, Michal ValkoReinforcement LearningOnline Mirror Descent

  6. Behavioral Cloning Outperforms Entropy-Regularized RL: Critic-Driven Failure of Actor-Critic Methods on Adaptive Tumor Treatment

    Sep 6, 2026Aleksandar Dimitrov, Giacomo SpiglerActor-Critic MethodsSoft Actor-Critic

  7. WarpSAC: Towards the Pinnacle of Scalable Off-policy RL by Rethinking Exploration and Exploitation

    Aug 25, 2026Zihao Wu, Hongyao Tang, Yi Ma +9Reinforcement LearningOff-Policy RL

  8. Spiking Neural Networks for Continuous Control: Neuromorphic Reinforcement Learning in Conventional Computing

    Aug 24, 2026Jessica Hunter, Md Maruf Hossain Shuvo, Krishna RoyReinforcement LearningSpiking Neural Networks

  9. Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control

    Aug 10, 2026Faizan Ahmed, Aniket Dixit, James BruseyRL ControlFeedback Control

  10. LooperMuscle: Fast and Stable Learning of Humanoid Whole-Body Tracking via Structured Mixture-of-Experts

    Aug 1, 2026Boyi Liu, Qijin Li, Tianqi Yu +2Robotic RLHumanoid Motion Tracking

  11. Hierarchical Soft Actor-Critic for Sparse-Reward Long-Horizon Reinforcement Learning

    Jul 26, 2026Zahra Abdalla Elashaal, Afef Hfaiedh, Nahla Khraief +2Reinforcement LearningHierarchical RL

  12. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning

    Jul 21, 2026Ubayd Ali Bapoo, Clement N NyirendaReinforcement LearningSoft Actor-Critic

  13. Active Beyond-Diagonal RIS Empowered Heterogeneous Edge Computing: A Distributional Reinforcement Learning Approach

    Jul 14, 2026Tianyu Pang, Hongyu LiDistributional RLReconfigurable Intelligent Surfaces

  14. Multi-Head Attention-Based Feature Extractor Integration with Soft Actor-Critic for Porosity Prediction and Process Parameter Optimization in Additive Manufacturing

    Jun 18, 2026Kianoush Aqabakee, Leonardo StellaMaterials Property PredictionSoft Actor-Critic

  15. Adaptive Reinforcement Learning for Robust Open Quantum System Control: A Multi-Task Framework with Temporal Optimization

    May 26, 2026Haftu W. Fentaw, Steve Campbell, Simon CatonRL ControlMulti-Task RL

  16. Revisiting Mixture Policies in Entropy-Regularized Actor-Critic

    May 9, 2026Jiamin He, Samuel Neumann, Jincheng Mei +2RL ControlPolicy Optimization

  17. Distributional Reinforcement Learning via the Cramér Distance

    Apr 26, 2026Vanya Aziz, Ivo Nowak, E. M. T HendrixDistributional RLRobotic RL

  18. FlashSAC: Fast and Stable Off-Policy Reinforcement Learning for High-Dimensional Robot Control

    Apr 6, 2026Donghu Kim, Youngdo Lee, Minho Park +10Off-Policy RLRobotic RL

  19. Efficient Soft Actor-Critic with LLM-Based Action-Level Guidance for Continuous Control

    Mar 18, 2026Hao Ma, Zhiqiang Pu, Xiaolin Ai +1LLM-Guided RLRL Exploration

  20. Squint: Fast Visual Reinforcement Learning for Sim-to-Real Robotics

    Feb 24, 2026Abdulaziz Almuzairee, Henrik I. ChristensenVisual RLSoft Actor-Critic

  21. ManeuverNet: A Soft Actor-Critic Framework for Precise Maneuvering of Double-Ackermann-Steering Robots with Optimized Reward Functions

    Feb 16, 2026Kohio Deflesselle, Mélodie Daniel, Aly Magassouba +2Robotic RLAgricultural Robotics

  22. Continuous-Time Reinforcement Learning for Asset-Liability Management

    Sep 27, 2025Yilie HuangFinanceContinuous-Time RL

  23. Constrained Reinforcement Learning for Safe Heat Pump Control

    Sep 29, 2024Baohe Zhang, Lilli Frison, Thomas Brox +1RL ControlConstrained RL