Stein Variational Uncertainty-Adaptive Model Predictive Control

Reliable robotic manipulation requires control policies that can accurately represent and adapt to uncertainty arising from contact-rich interactions. Modern data-driven methods mitigate uncertainty through large-scale training and computation, and degrade significantly in performance with limited number of training samples. By contrast, classical model-based controllers are computationally efficient and reliable, but their limited ability to represent task-relevant uncertainty can hinder performance in contact-rich interactions. In this work, we propose to expand the capabilities of model-based manipulation control through more flexible uncertainty modeling that retains performance while exactly adapting to uncertainty. Our approach casts the manipulation problem as a distributionally robust control optimization and proposes a novel deterministic formulation based on Stein variational inference that preserves performance while explicitly modeling task-sensitive parameter uncertainty. As a result, the derived controllers are more aware of task sensitivities to uncertainty, yielding high reliability without compromising performance. Experimental results demonstrate up to 3$\times$ improved robustness across a range of contact-rich manipulation tasks under broad parametric uncertainty, outperforming existing model-based control methods.

Many safety-critical control systems operate under latent uncertainty that sensors cannot resolve at decision time. Such uncertainty, arising from unknown physical properties, disturbances, or unobserved geometry, affects dynamics, task feasibility, and safety margins. Standard methods optimize expected performance and offer limited protection against rare but severe outcomes, while robust formulations treat uncertainty conservatively without exploiting its probabilistic structure. We consider systems with measured state and an unknown, time-invariant parameter represented by a belief distribution. We propose a risk-sensitive belief-space Model Predictive Path Integral (MPPI) controller that plans under this belief, regularizes performance using Conditional Value-at-Risk (CVaR), and imposes a CVaR constraint on a trajectory safety margin over the horizon. For the exact risk-constrained formulation underlying this controller, we establish three properties: (1) the CVaR constraint implies a probabilistic safety guarantee, (2) the controller recovers the risk-neutral optimum as the objective risk weight tends to zero, and (3) a union-bound argument extends the per-horizon guarantee to cumulative safety over repeated solves. In contact-rich MuJoCo simulations of vision-guided dexterous stowing, where a manipulator inserts a grasped object into an occupied slot with pose uncertainty exceeding prescribed lateral clearance requirements, our method achieves 82% success with zero contact violations at high risk aversion, compared with 55% and 50% for a risk-neutral configuration and a chance-constrained baseline, both of which incur nonzero exterior contact forces. Project page: https://clintonenwerem.com/belief-cvar-mppi/.

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning combined with domain randomization has shown promise in mitigating the sim-to-real gap, simultaneously handling all the sources of uncertainty often leads to sub-optimal policies and poor learning efficiency. This study proposes continual uncertainty learning (CUL), a curriculum-based continual learning framework for robust control of nonlinear systems on which multiple heterogeneous uncertainties are simultaneously superimposed. The core idea is to decompose the original control problem into a sequence of continual learning tasks by extending the system into a set of plants whose uncertainties are progressively expanded and diversified, so that the strategy for handling each uncertainty is acquired sequentially. Within this curriculum, the policy is updated across the plant sets under a memory-efficient anti-forgetting regularization, which preserves the strategies acquired for earlier uncertainties. In parallel, a model-based controller that guarantees a shared baseline performance across all the plant sets is embedded in the learning process, so that the agent learns only the residual compensation for each uncertainty, thereby substantially enhancing sample efficiency. The proposed framework is applied to the design of an active vibration controller for automotive powertrains as a practical industrial application. Comparative validation demonstrates that the resulting controller remains robust against structural nonlinearities and dynamic variations over a wide range of plant conditions while improving the control performance.