Soft Actor-Critic

Also known as SAC

Overview

Soft Actor-Critic (SAC) learns continuous actions by combining reward with an entropy bonus, encouraging exploration, while replay buffers and twin critics support sample-efficient off-policy training. Research builds on this core with distributional critics, ensembles, hierarchical policies, safety constraints, and guidance to improve value estimates, exploration, and long-horizon planning. SAC is studied in settings including robotic locomotion and manipulation, building control, and autonomous driving, with sim-to-real transfer an important goal. A central tension is improving data efficiency and scaling to complex tasks without unstable or overestimated critics, while choosing enough exploration to learn useful behavior.

Latest papers

CardsList

31 papers2 papers in the last four weeks, down 60% on the four weeks before. 0.0% of all new papers.

  1. Enhancing Hardware Fault Tolerance in Machines with Reinforcement Learning Policy Gradient Algorithms

    Jul 21, 2024Sheila Schoepp, Mehran Taghian, Shotaro Miwa +3RL ControlReinforcement Learning