cs.LGNov 4, 2026

Learning to Tune with Biased Gradients: Iterative Feedback Tuning of Model-Free Control on Throttle Valves

Authors: Félix Martinez-Jiménez, Sander Miller-Murphy, Tobie Ondoa-Essomba, Emmanuel Witrant

Organizations: GIPSA-INFINITY

Abstract

Iterative feedback tuning (IFT) learns the parameters of a fixed-structure controller by stochastic gradient descent. At each iteration, two closed-loop experiments are run on the plant: the first one measures the tracking error, and the second one, driven by this error, provides the sensitivities from which the gradient of the cost is estimated. This estimate is unbiased for linear plants only. We study the biased case on automotive electronic throttle valves, whose friction and stiction vary between valves and runs, controlled by an intelligent proportional (model-free) controller, which is an incremental PI controller. We show that the mismatch of the controller state at the start of the two experiments, which stiction makes unavoidable, adds an error inversely proportional to the amplitude of the second experiment. On digital twins of ten valves, the IFT gradient is a descent direction in only 69% of the low-cost region, friction being the cause, and all update rules plateau and then drift. On two hardware valves, the best update rule depends on the noise structure of the gradient. On the first valve, where one gradient component is buried in noise, Adam outperforms Gauss--Newton, its normalisation and its momentum each improving one parameter. On the second valve, where both components are consistent, the same normalisation amplifies a direction that Gauss--Newton rightly discounts, and Adam drifts to a controller worse than the initial one. The twins reproduce the mechanism but not this ranking.

Explore similar work

CardsList
  1. MetaTune: Adjoint-based Meta-tuning via Robotic Differentiable Dynamics

    Mar 28, 2026Xiexin Peng, Bingheng Wang, Tao Zhang +2Robust ControlFeedback Control

  2. Audited Gradients, Anchored Policies: Model-Based Reinforcement Learning for Efficient Flow Control

    Nov 9, 2026Ruige Kong, Stefania FrescaModel-Based RLSurrogate-Assisted Optimization

  3. Structure from Reasoning, Numbers from Search: On-Premise Open LLMs as Structural Priors for Coupled MIMO Controller Tuning

    Jun 9, 2026Jiaxuan Chen, Haonan Li, Yang ShuLanguage Model-Based ControlLarge Language Model-Guided Optimization