Contact-Adaptive Robotic Ultrasound Probe Control for Tissue Exploration and Continuous Task-Relevant Visualization Using Robot-Free Image-Motion Demonstration
Authors: Seong Jeong, Minsung Kim, Dongho Yee, Juahn Oh, Yechan Seo, Jiyul Lee, Jinseok Lee, Seonho Shim, +3 more
Organizations: Department of Transdisciplinary Medicine, Seoul National University Hospital · Rosota Inc., Seoul, Republic of Korea · Department of Medicine, Seoul National University College of Medicine · Department of Mechanical Engineering, Seoul National University · Department of Computer Science and Engineering, Seoul National University · Eulji University College of Medicine, Daejeon, Republic of Korea · Department of Mechanical Engineering, Chungang University, Seoul, Republic of Korea · Interdisciplinary Program in Medical Informatics, Seoul National University College of Medicine · Institute of Convergence Medicine with Innovative Technology, Seoul National University Hospital
Robotic ultrasound commonly targets standardized views, predefined scanning protocols, or expert-scan reproduction. We target a different role: while a clinician performs the primary procedure, a robotic assistant maintains a clinician-selected view so that changing tissue remains observable. We present contact-adaptive robotic ultrasound monitoring derived from robot-free demonstrations. Sonologger clamps a six-axis inertial sensor to the clinician-operated probe and records synchronized ultrasound and probe-frame relative rotations without a robot, camera, or tracker. Rather than imitating trajectories, the recordings measure which probe axis and sign the clinician uses to correct an image offset. A measured image latency is removed before still-move-still segmentation yields relative-rotation labels; translation is excluded from control because of inertial drift. These measurements parameterize the Demonstration-Informed Image-Motion Controller (DIMC), an interpretable, non-learned controller combined with beam-axis force regulation and an independent safety supervisor with 5 N forced retreat. On a dynamic bladder phantom, DIMC acquired and held a task-relevant view in 7 of 7 blind, pose-paired trials versus 1 of 7 for a static hold (McNemar p = 0.031), and retained the view during syringe-driven hydro-distension while the supervisor bounded the force excursion. The framework offers an operational representation of ultrasound context for contact-adaptive intraoperative monitoring; clinical validation remains future work.
Figures & tables
Fig. 2: Sonologger: robot-free image–motion acquisition. (a) BNO085 on an nRF52840 board clamped to the C10UR probe. (b) Freehand acquisition on phantom A with a laptop; no robot, camera or tracker is present. (c) Probe frame in which every relative-rotation label is expressed: x lateral, y elevational (image-plane normal), z beam; θy is the in-plane rotation. (d) One lateral-search episode: gyroscope magnitude with the still mask (grey), the sector image at each still and the relative rotation between stills. (e) Effective image latency: correlation of image change with the box-integrated gyroscope magnitude against lag, pooled over 226 sessions (thick) and for 40 sessions (thin); the peak is at 200ms . (f) Corpus composition: 268 sessions, 45902 frames, 1818 move segments, 4389 chunks. (g) Behavioral measurements from the demonstrations: only θy of ( 1 ) correlates with the lateral centroid offset before the move (Spearman ρ=-0.46 , $n=$3920 chunks), and the fraction of corrective moves rises from chance (dashed) inside the dead band to 92% at ∣dx∣≥0.10$$ ( n=518 , 525, 649 and 536 per bin).
Fig. 3: From robot-free demonstrations to DIMC and the force and safety stack. Offline (dashed) the demonstrations supply the behavioral parameters of the Demonstration-Informed Image–Motion Controller (DIMC), which axis is corrected, in which sign and from what offset, plus the U-Net labels; a 60s robot self-probe supplies the gain magnitude, the image responses, the frame map and the safe search ranges. Online (solid, 10Hz ) the sector image is segmented, reduced to area, centroid and largest-component features, and turned into a twist by the Find or Hold mode of DIMC; the beam axis is owned by the admittance loop and the independent safety supervisor.
Fig. 4: Force regulation and safety supervision hardware. (a) FR5 arm, PX6D force/torque sensor, printed mount and a probe replica on the force bench, with the console and the 500ml syringe. (b) The same stack with the C10UR probe on the gel phantom. (c) Probe frame ( x lateral, y elevational, z beam) and the safety supervisor’s envelope on ∥F∥ : 3N hold target, 4.5N warning, 5N forced retreat. (d) Compensated probe force against a laboratory scale over 0.92N9.85N ( n=19 ; slope 1.019 , one invalid trial open; dashed: identity, solid: fit).
Fig. 5: Platforms for dynamic contact conditions. (a) Force bench: a torso mannequin with an inflatable tube under the abdominal pad, driven by a 500ml syringe, and a 3D-scanned, printed replica of the clinical C10UR probe. (b) Dynamic bladder phantom: an agar-gelatin block with a double water-balloon lumen filled and emptied through a syringe line, scanned by the robot-held C10UR. (c) Contact-stiffness measurement of the gel with the same replica (inset). (d) Equilibrium force against indentation on the mannequin bench from the force holds, k=0.374\text{,}\mathrm{N}\text{,}{\mathrm{mm}}^{-1} , $R^{2}=$0.997 .
Target [N]
SD [N]
Mean error [N]
In band [%]
Peak [N]
0.5
0.023
−0.017
88.9
0.60
1.0
0.022
−0.013
83.9
1.10
1.5
0.022
−0.012
94.1
1.57
2.0
0.026
−0.016
89.9
2.09
2.5
0.029
−0.031
72.9
2.59
3.0
0.026
−0.015
89.7
3.10
Table 6
Fig. 6: Force regulation and safety response during syringe-induced surface displacement. Force holds, loop-on/off injection responses, and the 4.0N safety-retreat run are shown.
Fig. 7: Blind task-relevant view acquisition and maintenance. Seven DIMC episodes and static-hold outcomes; DIMC maintained the view in 7/7 poses versus 1/7 for static hold.
Pose
DIMC [s]
Static hold [s]
1
50.7
no
2
10.9
35.4
3
13.0
no
4
7.8
no
5
25.4
no
6
16.4
no
Table 9
Fig. 8: Hydro-distension view maintenance. DIMC retains the target through the force peak; static hold lacks image-centering adaptation.
Department of Mechanical Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA · Department of Chemical & Biological Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA · Department of Computer Science, The University of Alabama, Tuscaloosa, AL 35487, USA