cs.CVAug 24, 2026

MLLM-Assisted Audio VOS: A 3rd Place Report for the MeViS-Audio Track, 8th LSVOS Challenge

Authors: Liangtao Shi, Jinxia Xie, Xiantao Hu, Ting Liu

Organizations: Hefei University of Technology · Nanjing University of Science and Technology · Hunan Police College

Abstract

In this technical report, we present a training-free framework for audio-guided video object segmentation, which integrates Multimodal Large Language Models (MLLMs) with SAM-based segmentation models. We decompose the task into several stages and identify suitable foundation models for each stage. Without introducing additional model training or task-specific fine-tuning, our approach leverages the strong multimodal reasoning capabilities of MLLMs to model text-visual correspondence and employs SAM-based models for accurate object mask generation. The proposed framework demonstrates the effectiveness of leveraging foundation models for audio-guided video segmentation and achieves competitive performance in the MeViS-Audio Track of the 8th LSVOS Challenge.

Figures & tables

Explore similar work

CardsList
  1. 2nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VA

    Apr 27, 2026Zhiyu Wang, Xudong Kang, Shutao LiVideo Object Segmentation

  2. Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation

    Sep 5, 2026Chang Liu, Henghui Ding, Lingyi Hong +36Video Object SegmentationReferring Video Object Segmentation

  3. APRVOS: 1st Place Winner of 5th PVUW MeViS-Audio Track

    Apr 20, 2026Deshui Miao, Yameng Gu, Chao Yang +3Audio-Visual UnderstandingVideo Object Segmentation