TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control
Organizations: Sun Yat-sen University · Nanyang Technological University · Wuhan University · University of Science and Technology of China ·
Abstract
Recent text-to-motion models have improved motion quality and instruction following, yet many-step denoising and large model components make deployment slow and memory-intensive. We present Terminal-Amplification-Controlled Distillation (TACD), an on-policy approach for training efficient motion generators from text prompts and pretrained teachers, without real-motion training data. Building on segmented on-policy flow distillation, we supervise clean-motion predictions along student-generated trajectories. We identify a failure mode in which velocity matching on a fixed supervision grid repeatedly overweights errors near the denoising endpoint, degrading few-step generation. TACD ties the latest teacher query to the student's step size, bounding the effective loss weights in clean-motion space without changing inference. Experiments on HumanML3D and KIT-ML demonstrate improved few-step generation, including a 58% reduction in eight-step HY-Motion student FID relative to distillation without this bound. For diffusion teachers, the endpoint-matching form of TACD yields four-step students with lower FID and matched or improved text-motion retrieval relative to their 50-step teachers on HumanML3D. On HY-Motion and Kimodo, eight-step students with compact components achieve 7.7-11.9x end-to-end speedups and reduce peak GPU memory by 3.8-6.7x relative to their teachers. Project page: https://vkgo.github.io/TACD/
Figures & tables
| Method | NFE | R@1 | R@2 | R@3 | MM-Dist | FID | Div | CLIP |
|---|---|---|---|---|---|---|---|---|
| Real motions | – | .505 | .702 | .801 | 3.241 | – | 10.33 | .638 |
| HY-Motion flow teacher; students at eight steps, three-seed means | ||||||||
| HY-Motion teacher | 50 | .415 | .601 | .708 | 4.056 | 3.119 | 9.47 | .604 |
| HY-Motion Lite (released) | 50 | .394 | .578 | .685 | 4.243 | 3.741 | 9.29 | .589 |
| Truncated teacher | 8 | .369 | .544 | .646 | 4.721 | 6.816 | 8.92 | .510 |
| Uncapped student (DX, ) | 8 | .343 | .528 | .647 | 4.562 | 7.559 | 8.24 | .569 |
| Method | Training signal | NFE | R@1 | R@3 | MM-Dist | FID | Div | MMod |
|---|---|---|---|---|---|---|---|---|
| MLD teacher ( Chen et al., 2023 ) and MotionLCM-V1 ( Dai et al., 2024b ) | ||||||||
| MLD teacher (DDIM) | Reference | 50 | .502 | .795 | 3.048 | .387 | 9.53 | – |
| Truncated MLD teacher | None | 4 | .459 | .768 | 3.295 | .585 | 9.49 | – |
| MotionLCM-V1 | Real motions | 4 | – | .798 | – | .286 | – | – |
| TACD | Teacher outputs | 4 | .525 | .818 | 2.909 | .222 | 9.80 | – |
| MotionLCM-V2 teacher and student ( Dai et al., 2024a ) | ||||||||
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Purpose | Student / encoder | Loss; sampling grid; margin | Replication | |
|---|---|---|---|---|
| Flow controls | 1B LoRA-32 / 8B | 4 | Uncapped/grid cap/ last-point; uniform; | 3 each |
| Lite controls | Lite full / 0.6B | 8 | Original/grid cap/ endpoint/last-point; uniform; | 3 each |
| Coefficient interventions | Lite full / 0.6B | 8 | Weight cap on original grid; on capped grid | 3 each |
| Gradient probe | Lite full / 0.6B | 8 | Uncapped/grid cap; uniform; | 32 batches 2 probe seeds |
| DDIM transfer | Teacher-size / native | 4 | Endpoint matching; native DDIM grid | MLD/V2: 3 |
| Model | NFE | CFG | FID | R@3 | MM-Dist |
|---|---|---|---|---|---|
| Teacher (1B), 50 steps | 50 | 2.0 | 0.9937 | 0.7052 | 3.7308 |
| Teacher (1B), 50 steps | 50 | 3.0 | 0.6989 | 0.7312 | 3.5619 |
| Teacher (1B), 50 steps | 50 | 5.0 | 0.5407 | 0.7431 | 3.4706 |
| Teacher (1B), 50 steps | 50 | 7.5 | 0.5487 | 0.7408 | 3.4893 |
| Teacher (1B), 8 steps (truncated) | 8 | 5.0 | 3.2503 | 0.6516 | 4.2250 |
| Student (0.46B), uncapped (s42) | 8 | 5.0 | 2.5631 | 0.7056 | 3.7131 |
| Method | NFE | FID | R@3 | Div |
|---|---|---|---|---|
| Teacher (MLD, 50) | 50 | 0.387 | 0.795 | 9.53 |
| Truncated teacher | 4 | 0.585 | 0.768 | 9.49 |
| MotionLCM-V1 (consistency) | 4 | 0.286 | 0.798 | – |
| TACD | 4 | 0.222 .002 | 0.818 | 9.80 |
| Method | NFE | R@1 | R@3 | MM-Dist | FID | Div |
|---|---|---|---|---|---|---|
| (a) Published generators (real-motion training) | ||||||
| Real motions ( Guo et al., 2022 ) | – | .424 | .779 | 2.788 | .031 | 11.08 |
| T2M ( Guo et al., 2022 ) | – | .361 | .681 | 3.488 | 3.022 | 10.72 |
| MotionDiffuse ( Zhang et al., 2024 ) | – | .417 | .739 | 2.958 | 1.954 | 11.10 |
| MDM † ( Tevet et al., 2023 ) | 1000 | .404 | .731 | 3.096 | .513 | 10.73 |
| MLD ( Chen et al., 2023 ) | 50 | .390 | .734 | 3.204 | .404 | 10.80 |
| Method | NFE | R@1 | R@3 | MM-Dist | FID | Div | FID by seed |
|---|---|---|---|---|---|---|---|
| Real motions (GT) | – | .426 | .780 .005 | 2.786 | .027 .004 | 10.99 | – |
| MDM teacher | 1000 | .403 | .725 .005 | 3.115 | .506 .023 | 10.74 | – |
| Truncated teacher | 2 | .395 | .728 .005 | 3.193 | 1.530 .063 | 11.24 | – |
| TACD | 2 | .410 | .756 | 2.996 | 1.038 | 11.06 | 1.020 / 1.077 / 1.017 |
| Truncated teacher | 4 | .410 | .755 .006 | 3.014 | .976 .064 | 11.38 | – |
| TACD | 4 | .416 | .761 | 2.932 | .852 | 11.16 | .840 / .857 / .859 |
| Method | NFE | R@1 (%) | R@3 (%) | FID | GT-R@1 (%) | Lat.(s) | VRAM |
|---|---|---|---|---|---|---|---|
| Teacher | 100 | 73.15 | 88.63 | 0.045 | 75.66 | 2.96 | 15.3G |
| Truncated teacher | 8 | 69.36 | 84.35 | 0.064 | 72.66 | 0.29 | 15.3G |
| Truncated teacher | 4 | 67.05 | 82.37 | 0.079 | 70.55 | 0.18 | 15.3G |
| Truncated teacher | 2 | 60.46 | 77.27 | 0.107 | 63.14 | 0.13 | 15.3G |
| TACD, 8B enc. | 8 | 71.39 .50 | 86.55 .25 | 0.054 | 75.01 .37 | 0.29 | 15.3G |
| TACD, 8B enc. | 4 | 68.42 .69 | 83.25 .38 | 0.067 | 72.13 .77 | 0.18 | 15.3G |
| Method | Encoder | NFE | R@1 (%) | R@3 (%) | FID | Time (s) | Memory (GB) |
|---|---|---|---|---|---|---|---|
| Teacher | 8B | 100 | 73.15 | 88.63 | 0.045 | 2.96 | 15.3 |
| Truncated teacher | 8B | 8 | 69.36 | 84.35 | 0.064 | 0.29 | 15.3 |
| TACD | 8B | 8 | 71.39 | 86.55 | 0.054 | 0.29 | 15.3 |
| TACD (Kimodo) | 1B | 8 | 68.86 | 86.66 | 0.054 | 0.25 | 4.0 |
| Truncated teacher | 8B | 4 | 67.05 | 82.37 | 0.079 | 0.18 | 15.3 |
| TACD | 8B | 4 | 68.42 | 83.25 | 0.067 | 0.18 | 15.3 |
| Conditioning encoder | NFE | R@1 (%) | R@3 (%) | FID | GT-R@1 (%) |
|---|---|---|---|---|---|
| teacher’s own 8B encoder | 8 | 71.72 .50 | 86.66 .33 | 0.0542 .0002 | 75.25 .10 |
| 1B encoder, trained in | 8 | 68.86 .44 | 86.66 .28 | 0.0544 .0003 | 72.60 .67 |
| paired (1B 8B) | 8 | [ , ] | [ , ] | [ , ] | [ , ] |
| Model / steps | end to end | sampling | text enc. | peak GB |
|---|---|---|---|---|
| 1B teacher Qwen3-8B, 50 steps | ms | |||
| 0.46B Lite Qwen3-8B, 50 steps | ms | |||
| TACD (HY-Motion): 0.46B Qwen3-0.6B, 8 steps | ms |
Diffusion Model Distillation
Diffusion model distillation transfers a large model’s generative behavior to faster or smaller models that need fewer sampling steps.
See all 191 papers