This technical report explores the MOSEv2 track of the PVUW 2026 Challenge, which targets complex semi-supervised video object segmentation. Built on SAM3, we develop an automatic re-prompting framework to improve robustness under target disappearance and reappearance, severe transformation, and strong same-category distractors. Our method first applies the SAM3 detector to later frames to identify same-category object candidates, and then performs DINOv3-based object-level matching with a transformation-aware target feature pool to retrieve reliable target anchors. These anchors are injected back into the SAM~3 tracker together with the first-frame mask, enabling multi-anchor propagation rather than relying solely on the initial prompt. This simple directly benefits several core challenges of MOSEv2. Our solution achieves a J&F of 51.17% on the test set, ranking 3rd in the MOSEv2 track.
Figures & tables
Figure 1: Overview of our two-stage framework. In the first stage, given the first-frame ground-truth mask as the visual prompt, we apply the SAM 3 detector to all remaining video frames to identify same-category object candidates, visualized by colored masks. Zoomed-in views are included for clearer visualization, as the target objects are often small. The detected regions are then encoded by DINOv3 and matched against a transformation-aware target feature pool constructed from the first-frame target, and a few high-confidence anchors are selected from later frames. In the second stage, the first-frame mask together with the selected anchor masks are used to re-prompt the SAM 3 tracker for mask propagation.
Figure 2: Qualitative comparison between first-frame-only propagation and our re-prompting strategy. The percentages indicate the temporal progress of each frame within the video. For each example, row (a) shows the original video frames, where the red box in the first frame marks the target object. Row (b) shows the result without re-prompting, where only the first-frame mask is used for propagation. Row (c) shows the result of our method.
Participant
J&F˙
J
F˙
J&F˙d
J&F˙r
F
J&F
HITsz_Dragon
56.91
54.71
59.12
62.09
44.11
62.39
58.55
tobedone
55.16
53.02
57.29
58.51
44.47
61.02
57.02
HCVG
51.17
49.55
52.80
66.23
32.60
55.13
52.34
newsota
48.19
46.16
50.22
55.36
37.21
52.97
49.56
rozumrus
44.83
43.18
46.48
55.81
31.29
48.96
46.07
⋯
Table 1: Quantitative comparisons on the MOSEv2 test set. Our results are highlighted in the blue row.
We present our solution for the MOSEv2 track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge at ECCV 2026. The challenge evaluates robust video object segmentation under complex temporal dynamics, including long-term occlusion, disappearance and reappearance, large appearance changes, and strong interference from visually similar objects. Our method builds on SAM3 and focuses on its memory readout. Standard target-only memory retrieval can confuse the annotated target with same-class non-target objects because such distractors are represented only implicitly as background. Our method introduces Competitive Memory Readout, which explicitly incorporates same-class competitor evidence when retrieving target information from memory. To prevent excessive suppression of weak or reappearing targets, we further apply a lightweight adaptive restoration rule after competition. The resulting system retains the original SAM3 tracking pipeline while improving target identity preservation in challenging videos. Our submission achieves 66.20 on the primary challenge score and ranks 2nd in the MOSEv2 track.
Mingqi Gao, Sijie Li, Jungong Han
School of Computer Science, University of Sheffield · Department of Automation, Tsinghua University
In the Complex Video Object Segmentation task, researchers are required to track and segment specific targets within cluttered environments, which rigorously tests a method's capability for target comprehension and environmental adaptability. Although SAM3, the current state-of-the-art solution, exhibits unparalleled segmentation performance and robustness on conventional targets, it underperforms on tiny and semantic-dominated objects. The root cause of this limitation lies in SAM3's insufficient comprehension of these specific target types. To address this issue, we propose TEP: Advancing Complex Video Object Segmentation via Tracking-Enhanced Prompts. As a training-free approach, TEP leverages external tracking models and Multimodal Large Language Models to introduce tracking-enhanced prompts, thereby alleviating the difficulty SAM3 faces in understanding these challenging targets. Our method achieved first place (56.91%) on the test set of the PVUW Challenge 2026: Complex Video Object Segmentation Track.
Jinrong Zhang, Canyang Wu, Xusheng He +3
Harbin Institute of Technology, Shenzhen, China · Shenzhen Loop Area Institute, China
This report presents our winning solution to the 5th PVUW MeViS-Text Challenge. The track studies referring video object segmentation under motion-centric language expressions, where the model must jointly understand appearance, temporal behavior, and object interactions. To address this problem, we build a fully training-free pipeline that combines strong multimodal large language models with SAM3. Our method contains three stages. First, Gemini-3.1 Pro decomposes each target event into instance-level grounding targets, selects the frame where the target is most clearly visible, and generates a discriminative description. Second, SAM3-agent produces a precise seed mask on the selected frame, and the official SAM3 tracker propagates the mask through the whole video. Third, a refinement stage uses Qwen3.5-Plus and behavior-level verification to correct ambiguous or semantically inconsistent predictions. Without task-specific fine-tuning, our method ranks first on the PVUW 2026 MeViS-Text test set, achieving a Final score of 0.909064 and a J&F score of 0.7897. The code is available at https://github.com/Moujuruo/MeViSv2_Track_Solution_2026.
Xusheng He, Canyang Wu, Jinrong Zhang +3
Harbin Institute of Technology, Shenzhen, China · Shenzhen Loop Area Institute, China