InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Reading
Organizations: State University of New York at Buffalo, Buffalo, NY 14260, USA
Abstract
Home-based interventions like parent-child shared reading provide a cost-effective approach for supporting children with autism spectrum disorder (ASD). However, analyzing caregiver intervention strategies in naturalistic home interactions typically relies on expert annotation, which is costly, time-intensive, and difficult to scale. To address this challenge, we propose InterventionLens, an end-to-end multi-agent system for automatically detecting and temporally segmenting caregiver intervention strategies from shared reading videos. Without task-specific model training or fine-tuning, InterventionLens uses a collaborative multi-agent architecture to integrate multimodal interaction content and perform fine-grained strategy analysis. Experiments on the ASD-HI dataset show that InterventionLens achieves an overall F1 score of 79.44%, outperforming the baseline by 19.72%. These results suggest that InterventionLens is a promising system for analyzing caregiver intervention strategies in home-based ASD shared reading settings. Additional resources will be released on the project page.
Figures & tables
| Method | Prec. | Rec. | F1 |
| Baseline | 50.21 | 73.68 | 59.72 |
| Ours | 82.36 3.44 | 76.75 0.49 | 79.44 1.84 |
| Gain | +32.15 | +3.07 | +19.72 |
| Strategy | Prec. | Rec. | F1 |
| Mand-Model | 91.87 1.19 | 87.88 0.75 | 89.82 0.31 |
| Modeling | 57.34 12.72 | 26.67 6.67 | 36.28 8.25 |
| Time Delay | 65.03 6.44 | 72.84 5.66 | 68.65 5.63 |
| Method | Prec. | Rec. | F1 |
| InterventionLens | 82.36 3.44 | 76.75 0.49 | 79.44 1.84 |
| w/o BMA | 70.22 3.49 | 67.79 1.28 | 68.97 2.35 |
| Drop | -12.14 | -8.96 | -10.47 |
| Strategy | InterventionLens | w/o BMA | F1 |
| Mand-Model | 89.82 0.31 | 80.27 2.90 | -9.55 |
| Modeling | 36.28 8.25 | 16.96 9.06 | -19.32 |
| Time Delay | 68.65 5.63 | 64.93 2.17 | -3.72 |