Is User Calibration Still Necessary for Continuous Myoelectric Control? A Closed-Loop Comparison of Calibration-Free Controllers
Organizations: Institute of Biomedical Engineering and the Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB E3B 5A3, Canada.
Abstract
The need for user-specific calibration remains an often-cited barrier to widespread adoption of myoelectric control. Cross-user models trained on large multi-user datasets can now recognize gestures from unseen users without calibration, but they have been evaluated almost exclusively offline, leaving open whether calibration is still needed in closed-loop control. This study compared six calibration-free controllers, trained on 306 users of the EMG-EPN-612 dataset and used without any calibration data from the test participant, against three calibrated controllers in a closed-loop Fitts' law target-acquisition task with sixteen participants. The calibrated controllers achieved higher offline balanced accuracy (90.6% against 73.1% for the best controller of each paradigm), but completion rates did not differ significantly between paradigms, and the highest completion rate was achieved by a calibration-free controller. Calibrated controllers moved faster on successful acquisitions, partly because of their individually fitted speed mappings, though not significantly after correction for multiple comparisons. However, every calibration-free controller produced more direct and stable trajectories than every calibrated controller, even after adjusting for cursor speed. Offline accuracy did not predict completion rate across controllers or within participants, and across paradigms higher offline accuracy was associated with poorer trajectory quality in 15 of 16 participants. Without any calibration data from the end user, a model trained across a large population matched calibrated control in completion rate and exceeded it in trajectory quality. The offline accuracy gained through calibration should therefore not be taken as evidence of a closed-loop benefit.
Figures & tables
| Condition | (px) | (px) | ID (bits) |
|---|---|---|---|
| Easy | 60 | 600 | 3.46 |
| Medium | 42 | 750 | 4.24 |
| Hard | 24 | 900 | 5.27 |
| Model | Balanced Accuracy (%) |
|---|---|
| Base | |
| Proto | |
| RestLoss | |
| Triplet | |
| RunNorm | |
| Segmented |
| Model | CR (%) | MT (s) | MT P (s) | TP (b/s) | TP P (b/s) |
|---|---|---|---|---|---|
| Base | |||||
| Proto | |||||
| RestLoss | |||||
| Triplet | |||||
| RunNorm | |||||
| Segmented |
| Model | Easy | Medium | Hard |
|---|---|---|---|
| Base | 81.8 | 68.2 | 45.3 |
| Proto | 86.5 | 67.7 | 50.0 |
| RestLoss | 88.5 | 75.0 | 49.0 |
| Triplet | 88.0 | 68.8 | 56.2 |
| RunNorm | 83.3 | 75.0 | 50.0 |
| Segmented | 85.9 | 76.0 | 56.2 |
| Model | Path Eff. | Dir. Ratio | Over. | Stop Dist. |
|---|---|---|---|---|
| Base | 63.8 | 2.99 | 0.57 | 10.3 |
| Proto | 63.1 | 3.17 | 0.53 | 11.6 |
| RestLoss | 64.6 | 3.03 | 0.42 | 6.7 |
| Triplet | 66.2 | 2.70 | 0.44 | 7.7 |
| RunNorm | 65.0 | 2.86 | 0.37 | 6.1 |
| Segmented | 64.2 | 2.90 | 0.44 | 9.0 |
| Completion Rate | Quality Composite | Pen. Movement Time | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Intervention | Diff. | Diff. | Diff. | ||||||
| Segmented | |||||||||
| Triplet | |||||||||
| RestLoss | |||||||||
| RunNorm | |||||||||
| Proto | |||||||||
| Metric | Diff. | Holm | |||
|---|---|---|---|---|---|
| Quality Composite | |||||
| Completion Rate (%) | |||||
| Movement Time (s) | |||||
| MT Pen. (s) | |||||
| Throughput Eff. (b/s) | |||||
| Throughput Nom. Pen. (b/s) |
Continuous Control
Continuous control studies how agents choose real-valued actions to steer dynamic systems toward goals while meeting performance and safety constraints.
See all 55 papers