In this technical report, we present a training-free framework for audio-guided video object segmentation, which integrates Multimodal Large Language Models (MLLMs) with SAM-based segmentation models. We decompose the task into several stages and identify suitable foundation models for each stage. Without introducing additional model training or task-specific fine-tuning, our approach leverages the strong multimodal reasoning capabilities of MLLMs to model text-visual correspondence and employs SAM-based models for accurate object mask generation. The proposed framework demonstrates the effectiveness of leveraging foundation models for audio-guided video segmentation and achieves competitive performance in the MeViS-Audio Track of the 8th LSVOS Challenge.
Figures & tables
Method
N-acc.
T-acc.
J
F
J&F
Final Score
MomentSeg
41.38
92.53
49.72
56.47
53.09
62.33
+ DAM4SAM
41.38
92.53
53.81
59.63
56.72
63.54
+ Consistency Verification
96.55
57.83
44.34
47.71
46.03
66.80
Table 1: Comparison of different models on the 8th LSVOS MeViS-Audio test set.