Skeleton-based rehabilitation assessment faces fundamental limitations of fixed topologies which cannot model compensatory patterns, uniform joint treatments overlook clinically important deviations, and lack of geometric understand- ing. We propose Concave-Convex Decomposition Sparse Topological Graph Convolutional Network (CC2-STG), a multi-stream model that combines geo- metric decomposition, sparse feature learning, and adaptive topology. Our framework decomposes joint relationships into complementary convex-concave distance functions to model both local and global movement characteristics, with sparse regularization with proximal optimization selecting clinically relevant geo- metric features, while multi-scale topological analysis captures non-anatomical joint dependencies in pathological movements. Experiments on the KiMoRe and UIPRMD datasets validate the effectiveness of our approach, achieving state-of-the-art performance on clinical pathological movement assessment.
Figures & tables
Figure 1: Overview of the proposed CC 2 -STG pipeline through three parallel streams.
Figure 2: The proposed CC 2 -STG architecture. (a) Overall architecture with three parallel streams-skeleton-geometry with SK attention, Convex-Concave geometric decomposition, and sparse topological streams-fused and processed through GRU layers for clinical score regression. (b) Shift-GCN block with shift-in and shift-out operations. (c) SK attention module architecture with multi-scale convolution branches.
Figure 3: Convex-Concave geometric feature extraction in which skeletal joint positions are used to compute pairwise distances, being decomposed into convex and concave components to capture both local and global movement characteristics.
Figure 4: Spare topological feature extraction pipeline. Pairwise Euclidean distances are computed between joints across temporal frames. For each joint, local descriptors are extracted at multiple scales and combined via learned softmax-normalized weights for non-anatomical joint dependencies in compensatory movements.
Model
Ex1
Ex2
Ex3
Ex4
Ex5
Ex6
Ex7
Ex8
Ex9
Ex10
Li et al. ( Li et al., 2018 )
0.011
0.029
0.036
0.014
0.017
0.019
0.027
0.025
0.027
0.047
Song et al. ( Song et al., 2020 )
0.011
0.006
0.010
0.014
0.013
0.009
0.017
0.017
0.008
0.038
Zhang et al. ( Zhang et al., 2020 )
0.022
0.003
0.016
0.016
0.003
0.003
0.021
0.025
0.027
0.066
Liao et al. ( Liao et al., 2020a )
0.011
0.028
0.029
0.012
0.019
0.012
0.018
0.023
0.023
0.042
S. Deb et al. ( Deb et al., 2022 )
0.009
0.006
0.013
0.006
0.008
0.006
0.011
0.016
0.008
0.031
Mourchid et al. ( Mourchid and Slama, 2023 )
0.011
0.009
0.013
0.009
0.009
0.013
0.022
0.020
0.013
0.014
Table 1: Performance comparison (MAD ↓ ) on UIPRMD Exercises 1–10. Best results in red and second-best in blue .
Model
MAD ↓
RMSE ↓
MAPE ↓
Ex1
Ex2
Ex3
Ex4
Ex5
Ex1
Ex2
Ex3
Ex4
Ex5
Ex1
Ex2
Ex3
Ex4
Ex5
Li et al. ( Li et al., 2018 )
1.378
1.877
1.452
0.675
1.662
2.344
2.823
2.034
1.078
2.575
3.491
5.298
4.188
2.130
3.752
Yan et al. ( Yan et al., 2018a )
0.889
2.096
0.604
0.842
1.218
2.017
3.262
0.799
1.331
1.951
2.339
6.136
1.727
2.325
3.802
Liao et al. ( Liao et al., 2020a )
1.141
1.528
0.845
0.468
0.847
2.534
3.738
1.640
0.792
1.941
2.589
3.976
2.023
1.354
2.312
Song et al. ( Song et al., 2020 )
0.977
1.282
1.033
0.715
1.536
2.165
3.345
1.679
2.018
3.198
2.605
5.202
2.968
3.599
4.959
Zhang et al. ( Zhang et al., 2020 )
1.757
3.139
1.737
1.202
1.853
2.916
4.140
2.615
1.836
2.916
5.034
10.456
5.774
3.797
6.531
Table 2: Performance comparison on the KiMoRe dataset across Exercises 1-5. All metrics report lower values as better performance. Best results per column are highlighted in red and second-best in blue .
Figure 5: Training convergence curves for CC 2 -STG on the KiMoRe dataset across Exercises 1-5 where left for MAD, enter for RMSE, and right for MAPE, and star markers indicating the epoch at which each exercise achieving optimal validation performance.
S1
S2
S3
MAD ↓
RMSE ↓
MAPE ↓
✓
✗
✗
0.360
0.794
0.830
✗
✓
✗
2.977
3.334
7.368
✗
✗
✓
1.322
2.292
3.302
✓
✓
✗
3.642
4.654
8.947
✓
✗
✓
0.439
0.733
1.035
✗
✓
✓
3.889
5.105
9.892
Table 3: Ablation study of different stream configurations.
Function pair
MAD ↓
RMSE ↓
MAPE ↓
Linear only ( d )
0.182
0.323
0.399
Squared only ( d2 )
0.218
0.300
0.481
Log only ( log(d+1) )
0.140
0.235
0.312
Polynomial pair ( d2,d3 )
0.130
0.231
0.285
RBF pair ( e−d,e−d2 )
0.114
0.171
0.238
Sqrt + log ( d,log(d+1) )
0.155
0.276
0.335
Table 4: Ablation on the choice of distance-function pair.
Figure 6: t-SNE visualization of feature representations from CC 2 -STG model. (a) Ground truth clinical score distribution. (b) Learned feature space from CC 2 -STG.
Figure 7: Learned joint importance scores from CC 2 -STG across KiMoRe Exercises 1-5 (top to bottom), where joints with highlighted borders indicating the highest importance weights.
College of Mechanical and Vehicle Engineering, Chongqing University, Chongqing 400044, China · Department of Mathematical Sciences, Tsinghua University, Beijing 100084, China · School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China +1