cs.ROJun 20, 2026

Deep RL- Tuned Mo del-Free Adaptive Control for Lower-Limb Exoskeletons During Sit-to-Stand Transitions

Authors: Ranjeet KumbharAppaso M. GadadeRajmeet SinghAshish SinglaRavinder Kumar

Abstract

Sit-to-stand (STS) transitions impose significant joint-loading demands on elderly individuals, making them a primary target for lower-limb exoskeleton assistance. However, accurate trajectory tracking during STS is challenging due to complex, time-varying human exoskeleton interaction dynamics and inter-subject variability that render model-based control approaches difficult to apply in practice. This paper presents an intelligent model free adaptive backstepping control strategy for a bilateral lower-limb exoskeleton during STS motion. The proposed controller design uses an ultra-local second-order model to avoid explicit system identification, while a Gaussian radial basis function (RBF) neural network estimates the unknown lumped dynamics online. To further improve phase-aware tracking performance, a Twin Delayed Deep Deterministic Policy Gradient (TD3) reinforcement learning agent is integrated as a supervisory gain scheduler that adaptively adjusts controller gains across the distinct phases of STS motion. The proposed controller is evaluated through co-simulation in MATLAB/Simulink and Simscape Multibody using OpenSim-derived reference trajectories and benchmarked against state-of-the-art controllers. Results demonstrate that the proposed controller achieves the lowest average RMSE of 0.078 degree across all joints, representing improvements of 60.2%, 54.4%, 48.7%, and 42.6% over proportional integral derivative (PID), model-free adaptive control (MFAC), linear quadratic regulator (LQR), and sliding-mode control (SMC), respectively. TD3 integration further reduces tracking error by 35%, 33%, and 79% at the hip, knee, and ankle joints compared to the standalone RBF-MFAC baseline. These results demonstrate the effectiveness and robustness of the proposed controller design for assistive exoskeleton control during STS transitions.

Explore similar work

Aug 28, 2025cs.RO

Uncertainty-Aware Ankle Exoskeleton Control

Lower limb exoskeletons show promise to assist human movement, but their utility is limited by controllers designed for discrete, predefined actions in controlled environments, restricting their real-world applicability. We present an uncertainty-aware control framework that enables ankle exoskeletons to operate safely across diverse scenarios by automatically disengaging when encountering unfamiliar movements. Our approach uses an uncertainty estimator to classify movements as similar (in-distribution) or different (out-of-distribution) relative to actions in the training set. We evaluated three architectures (model ensembles, autoencoders, and generative adversarial networks) on an offline dataset and tested the strongest performing architecture (ensemble of gait phase estimators) online. The online test demonstrated the ability of our uncertainty estimator to turn assistance on and off as the user transitioned between in-distribution and out-of-distribution tasks (F1: 89.2). This new framework provides a path for exoskeletons to safely and autonomously support human movement in unstructured, everyday environments.
Fatima Mumtaza Tourk, Bishoy Galoaa, Sanat Shajan +3
Jun 15, 2026cs.RO

ExoTraj: A General Lower-limb Exoskeleton Assistance Policy for Complex Environments

Adaptive torque prediction in dynamic exoskeleton scenarios requires expensive motion capture systems, which are infeasible in complex outdoor environments. Trajectory prediction has emerged as one of the effective approaches to address such an issue. However, the core challenges of exoskeleton trajectory prediction are twofold: establishing the mapping from multi-modal features to trajectory information; constructing the mapping from trajectory to torque. For the former, most existing methods perform only single-step prediction and neglect inter-subject trajectory variability, thereby limiting the trajectory optimization space and prediction generalization. To address this, this paper proposes a fast flow matching method that enables accurate trajectory prediction and better generalization for real-time performance, where trajectory generation errors and encoded observations are used to guide the training direction. For the second challenge, due to the high dynamics of the human-robot system and the strong coupling between perception and control, simple control methods struggle to achieve efficient assistance based on the predicted trajectory. This paper utilizes model predictive control and designs a novel optimization objective to optimize torque, ensuring the exoskeleton achieves comfortable and robust assistance. By integrating the above two components, the unified policy, denoted as ExoTraj, is developed to enable adaptive assistance in complex outdoor scenarios without high data acquisition cost. Experimental results show that compared to traditional methods, ExoTraj reduces cross-subject prediction error by 14.0% during the online phase and maintains robustness against external noise. Relative to the zero torque condition, ExoTraj decreases metabolic rate by 11.5-24.4%, heart rate by 1.7-19.5%, and peak muscle activation levels by 10.9-41.3%, respectively.
Xiao-Yin Liu, Guotao Li, Long Sun +2
Aug 6, 2026cs.RO

ATP: Anatomical Torque with Passivity-based Control Framework for Safe Upper-Limb Exoskeleton Assistance

Providing assistance across diverse movements is a central objective of exoskeletons, and anatomical knowledge can enable responsive support that generalizes across tasks. However, anatomical assistance has mainly been studied for lower-limb exoskeletons, where periodic, weight-bearing motions impose lower demands on torque precision. Extending such assistance to complex, nonperiodic upper-limb movements remains challenging. This paper proposes Anatomical Torque with Passivity-Based Control (ATP) for safe upper-limb exoskeleton assistance. First, a scalable musculoskeletal simulation framework trains a unified reinforcement-learning muscle controller that generalizes across upper-limb movements and generates anatomical reference torques without complex biomechanical computations. Second, an online torque-refinement scheme adapts the reference to diverse movements, suppresses tendon-induced spikes, and incorporates a learned anomaly score for safe and comfortable assistance. Third, an interaction torque controller delivers assistance through a cable-driven compliant exoskeleton without constraining motion to predefined trajectories, while an energy tank preserves passivity with theoretical guarantees on torque tracking and system passivity. Simulations and real-world experiments show accurate tracking of long-duration motion sequences and generalization to real-time human movements. The controller achieves accurate torque tracking while preserving passivity and resumes tracking after energy-tank replenishment. An EMG study with five participants further shows reduced target-muscle activity during static and dynamic tasks compared with gravity compensation and open-loop assistance, with reductions of up to 48% relative to movement without the exoskeleton in a dynamic multi-joint task.
Yu Chen, Gong Chen, Xiang Li