Soft Actor-Critic

Ask about this topic

Recent momentum

-50%

8 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Soft Actor-Critic.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Soft Actor-Critic.

104 papers

Latest in Soft Actor-Critic

Open your feed →
CardsList

  1. Fork Where the Model Changes Its Mind: Belief-Shift Branching for Tree-Structured Reinforcement Learning

    Sep 12, 2026Bin Lei, Yu Li, Prafulla Kumar Choubey +7BranchesVerifiable Rewards

  2. Unthrottling the Tanh Jacobian in SAC: A Negative Result on Bang-Bang Control and MetaDrive

    Sep 8, 2026Faiq ShamassSoft Actor-CriticJacobian

  3. CAST: Alternating State-Value Targets and Expanded Policy Gradients for Model-Based Reinforcement Learning

    Sep 8, 2026Pietro Noah Crestaz, Mohamed Yassine Kabouri, Nicolas Mansard +1Soft Actor-CriticPolicy Gradient

  4. AlphaRJM: Reward-Jump Memory for Stochastic Return-Guided Alpha Discovery

    Sep 8, 2026Sayan Dhan, Selvaraju NatarajanReward LearningSoft Actor-Critic

  5. Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

    Sep 3, 2026Kevin Du, Alexander Hoyle, Laura Ruis +1Reasoning ChainReasoning Traces

  6. Facet-0: A Robotic Foundation Model for Contact-Rich Precise Manipulation

    Sep 1, 2026Haoyuan Deng, Haichao Liu, Wenkai Guo +6Robotic ManipulationSoft Actor-Critic

  7. Locally-Guided Actor-Critic: Training a Goal-conditioned Actor with a Subgoal-aware Critic

    Aug 31, 2026Olivier Serris, Stéphane Doncieux, Olivier SigaudGoal-Conditioned Reinforcement LearningSoft Actor-Critic

  8. Co-Evolving Actor-Conditioned Critics for Non-Verifiable Generation

    Aug 31, 2026Jinyoung Kim, Muhammad Khalifa, Lajanugen Logeswaran +4CritiqueCritic

  9. S2-HWM: Sparse Event-Structured Hierarchical World Model for Long-Horizon Surgical Robot Manipulation

    Aug 13, 2026Shuzhe Zhang, Xin Zhu, Yinling Qian +1Action-Conditioned World ModelingScalable Robot Learning

  10. Contextual Quality-Diversity Evolutionary Reinforcement Learning for HVAC Control in Tropical Commercial Buildings

    Aug 11, 2026Tran Le VuHvac ControlSoft Actor-Critic

  11. Critic-Free Pretraining for Efficient Online Reinforcement Learning Fine-Tuning

    Aug 11, 2026Daoyi Li, Yixian Zhang, Wenbo Ding +2Offline Safe Reinforcement LearningSoft Actor-Critic

  12. Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control

    Aug 10, 2026Faizan Ahmed, Aniket Dixit, James BruseyHvac ControlSoft Actor-Critic

  13. V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control

    Aug 8, 2026Donghu Kim, Youngdo Lee, Hojoon Lee +6Simulation-Based Reinforcement LearningSafe Reinforcement Learning

  14. Learning Fault-Tolerant Locomotion with Adaptive Gait Timing

    Aug 7, 2026Giovanbattista Gravina, Luca Rossini, Carlo Rizzardo +2LocomotionGait Dynamics

  15. Learning Suffers More Than the Policy Class Under Partial Observability: A Closed-Form Analysis

    Aug 7, 2026Idil GözelSoft Actor-CriticPartial Observability

  16. DiDPO: Diff-in-Diff Policy Optimization for Coding Agent Training

    Aug 7, 2026Xucong Wang, Zhe Zhao, Liheng Yu +3Verifiable RewardsAgentic Reinforcement Learning

  17. Toward Integrating Adaptive Experience Replay and Online Uncertainty Estimation in Safe Actor-Critic Optimal Control

    Aug 5, 2026Mahshad Rastegarmoghaddam, Davoud Nikkhouy, Shima SamadzadehControl Barrier FunctionsSoft Actor-Critic

  18. Foundations of Reinforcement Learning and Control:Connections and New Perspectives

    Aug 3, 2026Claire Vernade, Onno Eberhard, Martha White +4Soft Actor-CriticLocomotion

  19. Hierarchical Multilevel Monte Carlo for Order-Optimal Neural Actor-Critic in Average-Reward CMDPs

    Jul 30, 2026Ankur Naskar, Vaneet AggarwalSoft Actor-CriticMarkov Decision Processes

  20. Collaborative Weighting with Pessimistic Critic for Mitigating Overestimation in Off-Policy Reinforcement Learning

    Jul 29, 2026Gong Gao, Xiao Lai, Ziqi Xie +3Soft Actor-CriticOff-Policy Reinforcement Learning

  21. Shared Voxel-Map-Based Cooperative Indoor UAV Guidance with a Multi-Agent Soft Actor-Critic Controller

    Jul 28, 2026Thomas Hickling, Dylan Wynne, Yu Su +1Multi-Drone CoordinationMulti-Robot Systems

  22. Hierarchical Soft Actor-Critic for Sparse-Reward Long-Horizon Reinforcement Learning

    Jul 26, 2026Zahra Abdalla Elashaal, Afef Hfaiedh, Nahla Khraief +2Hierarchical Reinforcement LearningSparse Rewards

  23. Deep Reinforcement-Learning-Guided Model Predictive Control for Preventing Overtakes in Autonomous Racing

    Jul 23, 2026Yufei Xi, Yijie Liao, Tulga ErsalAutonomous RacingModel Predictive Control

  24. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning

    Jul 21, 2026Ubayd Ali Bapoo, Clement N NyirendaMulti-Agent Reinforcement LearningSoft Actor-Critic

  25. Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners

    Jul 14, 2026Haseeb Shah, Lingwei Zhu, Adam White +1Soft Actor-CriticEfficient Control

  26. Actor-Critic Learning for Extended Mean Field Control with Deterministic Policies

    Jul 13, 2026Ziheng Cheng, Xin Guo, Huyên Pham +1Model-Free Reinforcement LearningSoft Actor-Critic

  27. PAC-ACT: Post-training Actor-Critic for Action Chunking Transformers

    Jul 10, 2026Yujie Pang, Zudong LiAction ChunksSoft Actor-Critic

  28. ART for Diffusion Sampling: Continuous-Time Control and Actor-Critic Learning

    Jul 2, 2026Yilie Huang, Wenpin Tang, Xun Yu ZhouDiffusion SamplingTimestep

  29. Guided Action Flow: Q-Guided Inference for Flow-Matching Vision-Language-Action Policies

    Jul 2, 2026Liuhaichen Yang, Zhuang Jiang, Chenchao Sheng +1Vision-Language-Action PoliciesFrozen Vision-Language Models

  30. Learning the Supports for Categorical Critic in Reinforcement Learning

    Jul 2, 2026Jen-Yen Chang, Takayuki Osa, Tatsuya HaradaSoft Actor-CriticValue Functions

  31. Gauging, Measuring, and Controlling Critic Complexity in Actor-Critic Reinforcement Learning

    Jul 1, 2026Konstantin GarbersSoft Actor-CriticCritic

  32. Dual-Flow Reinforcement Learning with State-Aware Exploration

    Jun 29, 2026Qijun Li, Zheng Fu, Qi Song +4Multimodal Action DistributionsSoft Actor-Critic

  33. PS-PPO: Prefix-Sampling PPO for Critic-Free RLHF

    Jun 29, 2026Doo Hwan Hwang, Kee-Eung KimReinforcement Learning From Human FeedbackActor--Critic Training

  34. BV-Blend: Uncertainty-Weighted Historical Baselines for Stable Critic-Free RL with Verifiable Rewards

    Jun 27, 2026Yupeng Chang, Yuan Wu, Yi ChangVerifiable RewardsDirect Advantage Estimation

  35. EVOM: Agentic Meta-Evolution of Actor-Critic Architectures for Reinforcement Learning

    Jun 24, 2026Boyun Zhang, Chao Wang, Kai WuSoft Actor-CriticSelf-Evolving Agents

  36. WaveForward: An Omnidirectional Passive Wheeled Quadruped Robot with Casters

    Jun 24, 2026Chuanlin Zhao, Qifeng Zheng, Shuhan Wang +3Quadrupedal RobotPassive

  37. Bias-Controlled Primal-Dual Natural Actor-Critic: Optimal Rates for Constrained Multi-Objective Average-Reward RL

    Jun 23, 2026Ankur Naskar, Swetha Ganesh, Vaneet AggarwalMulti-Objective Reinforcement LearningSoft Actor-Critic

  38. VisCritic: Visual State Comparison as Process Reward for GUI Agents

    Jun 23, 2026Jiachen QianGraphical User Interface AgentsProcess Reward Modeling

  39. CKM-Driven Communication-Aware UAV Intelligent Trajectory Optimization for Urban Inspection

    Jun 23, 2026Yang Xiaomeng, Jia Ziye, Zhu Qiuming +1Multi-Drone CoordinationUnmanned Aerial Vehicles

  40. FlowDPG: Deterministic Policy Gradient on Flow Matching Policies for Real-World Manipulation

    Jun 21, 2026Kexin Shi, Junyao Shi, Poorvi Hebbar +5Robotic Manipulation PoliciesConditional Flow Matching

  41. Robot Critics that Sweat the Small Stuff

    Jun 19, 2026Sruthi Sudhakar, Junbang Liang, Sreehari Rammohan +3Robot PoliciesSample-Level Supervision

  42. A Test-time Actor-Critic Approach to News Images Generation

    Jun 19, 2026Damianos Galanopoulos, Vasileios MezarisAi-Generated ImagesVisual In-Context Learning

  43. Stable Transformer-Actor-Critic Model Predictive Control: A Contraction Analysis Approach

    Jun 18, 2026Antonio Marino, Valerio Modugno, Marco CognettiModel Predictive ControlLyapunov Function

  44. Multi-Head Attention-Based Feature Extractor Integration with Soft Actor-Critic for Porosity Prediction and Process Parameter Optimization in Additive Manufacturing

    Jun 18, 2026Kianoush Aqabakee, Leonardo StellaSoft Actor-CriticAdditive Manufacturing

  45. SWAP: Symmetric Equivariant World-Model for Agile Robot Parkour

    Jun 18, 2026Kaixin Lan, Ze Wang, Hongyi Li +6Scalable Robot LearningRobots

  46. When Does Trajectory-Level Supervision Permit Efficient Offline Reinforcement Learning?

    Jun 16, 2026Xuanfei Ren, Tengyang XieOffline Safe Reinforcement LearningSoft Actor-Critic

  47. Agile Fall Recovery for Quadrotors with Bidirectional Thrust via Reinforcement Learning

    Jun 15, 2026Anke Zhao, Yuhang Zhong, Kenghou Hoi +5Soft Actor-CriticState Estimation

  48. Phi-Actor-Critic: Steering General-Sum Games to Pareto-Efficient Correlated Equilibria

    Jun 9, 2026Wongyu Lee, Francesco Lelli, Omran Ayoub +1Multi-Agent Reinforcement LearningSoft Actor-Critic

  49. Mitigating Bias in Low-SNR Financial Reinforcement Learning via Quantum Representations

    Jun 9, 2026Zeyu Liu, Xuanzhi Feng, Sing Kwong Lai +6Soft Actor-CriticSafe Reinforcement Learning

  50. Structure-Conditioned Actor-Critic Branches for Quality-Diversity Reinforcement Learning

    Jun 7, 2026Lianrong Zuo, Peilan Xu, Yong Liu +1Soft Actor-CriticBranches

  51. TT-DAC-PS: Twin-Target Deterministic Actor-Critic with Policy Smoothing for Optimal Trade Execution

    Jun 7, 2026Ilia Zaznov, Atta Badii, Julian Kunkel +1Soft Actor-CriticMarket

  52. Retry Policy Gradients in Continuous Action Spaces

    Jun 4, 2026Soichiro Nishimori, Paavo ParmasSoft Actor-CriticHigh-Dimensional Action Spaces

  53. Representation Learning Enables Scalable Multitask Deep Reinforcement Learning

    Jun 4, 2026Johan Obando-Ceron, Lu Li, Scott Fujimoto +3Multi-Task Reinforcement LearningSafe Reinforcement Learning

  54. From Ticks to Flows: Dynamics of Neural Reinforcement Learning in Continuous Environments

    Jun 2, 2026Saket Tiwari, Tejas Kotwal, George KonidarisSoft Actor-CriticSafe Reinforcement Learning

  55. Target Updates May Stabilize Linear Q-Learning: Periodic and Soft Dynamics

    May 31, 2026Donghwan LeeQ-LearningLinear Quadratic Regulator

  56. Weak Critics Make Strong Learners: On-Policy Critique Distillation for Scalable Oversight

    May 29, 2026Can Jin, Jiakang Li, Rui Wu +2Scalable OversightOn-Policy Distillation

  57. Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning

    May 29, 2026Vagul Mahadevan, Claire Chen, Shuze Daniel Liu +1Stochastic ApproximationTemporal Difference

  58. CA-AC-MPC: CUDA-Accelerated Actor-Critic Model Predictive Control

    May 27, 2026Antoonio Buo, Vittorio Cammarota, Michele Avagnale +3Model Predictive ControlSoft Actor-Critic

  59. Explicit Critic Guidance for Aligning Diffusion Models

    May 26, 2026Zhengyang Liang, Qihang Zhang, Ceyuan YangDiffusion ModelsReward Gradients

  60. Robust Koopman Control Barrier Filters for Safe Actor-Critic Reinforcement Learning

    May 26, 2026Dhruv S. Kushwaha, Zoleikha A. BironControl Barrier FunctionsSoft Actor-Critic