cs.RONov 18, 2026

Ferrofluid Shape Control with Deep Reinforcement Learning

Authors: Anthony Czubarow, Antonio Terpin, Raffaello D'Andrea

Organizations: Institute for Dynamic Systems and Control, ETH Zürich, Zürich, Switzerland.

Abstract

Ferrofluids are liquids containing magnetic nanoparticles, enabling shape control through external magnetic fields. This deformability supports their use as soft robotic bodies that can navigate confined spaces and manipulate objects. Their nonlinear continuum dynamics, however, make reliable control challenging. Existing work shows how spatial magnetic fields from electromagnet arrays can establish and maintain desired ferrofluid configurations. A complementary objective is to exploit the fluid's dynamics under limited actuation to reach prescribed shapes that may not be sustainable at equilibrium. Here, we use deep model-based reinforcement learning to control these transient shapes. Learning directly through physical interaction, our policies select current commands for a single fixed electromagnet based on visual observations, guiding the moving ferrofluid toward prescribed geometries. The learned policies repeatedly attain a variety of shapes spanning polygons, asterisks and pentominoes. These results demonstrate that learning directly from physical interaction enables reliable fluid shaping, opening new possibilities for controlling ferrofluid-based soft robots.

Figures & tables

Explore similar work

CardsList
  1. Self-Curriculum Model-based Reinforcement Learning for Shape Control of Deformable Linear Objects

    Feb 25, 2026Zhaowei Liang, Song Wang, Zhao Jin +2Deformable Object ManipulationCurriculum RL

  2. Shape-programmable Magnetic Soft Membranes for Mechanically Active Microchannels

    Jun 19, 2026Direnc Akyildiz, Fatih Kocabas, Xiangyi Tan +1Soft Robotics

  3. Closed-Loop Sim-to-Real Reinforcement Learning for Deformable Microfiber Shape Control

    May 20, 2026Alessandro Amici, Houari Bettahar, Veeti Jaakkola +1Sim-to-Real TransferDeformable Object Manipulation