OpenCodePapers

referring-video-object-segmentation-on-ref-davis17

Video SegmentationReferring Video Object Segmentation
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeJ&FJFModelNameReleaseDate
SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction✓ Link80.8SetCon2026-05-19
ReVEAL: Eliciting Role-Aware Latent Visual Evidence from MLLMs for Reasoning Video Object Segmentation✓ Link80.7ReVEAL (Qwen3VL-8B)2026-10-30
VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation✓ Link80.0VideoSEG-O3-2B2026-06-05
VIRST: Video-Instructed Reasoning Assistant for SpatioTemporal Segmentation✓ Link79.5VIRST2026-03-28
Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos✓ Link79.4Sa2VA-Qwen2.5VL-7B (extra data)2025-01-07
VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation✓ Link79.4VideoSEG-O3-4B2026-06-05
Unlocking Motion in Expressions: Temporal Calibration for Referring Video Object Segmentation✓ Link77.774.580.8EMC2026-08-17
ReVEAL: Eliciting Role-Aware Latent Visual Evidence from MLLMs for Reasoning Video Object Segmentation✓ Link77.7ReVEAL (Qwen2.5VL-7B)2026-10-30
Towards Streaming Referring Video Segmentation via Large Language Model✓ Link76.6StreamingRVOS-4B2026-06-03
Video Generation Models are General-Purpose Vision Learners76.4GenCeption Specialist-L2026-07-10
Training-Free Spatio-temporal Decoupled Reasoning Video Segmentation with Adaptive Object Memory76.073.278.8SDAM2026-03-02
PhysMLLMs: Spatial Priors for Unified Referring Segmentation and Grounded Reasoning of Images and Videos76.0PhysMLLMs2026-08-25
Decomposed Attention Fusion in MLLMs for Training-Free Video Reasoning Segmentation✓ Link75.2DecAF (training-free, Qwen2.5-VL-7B + SAM2) (extra data)2025-10-22
ReferEverything: Towards Segmenting Everything We Can Speak of in Videos75.0REM Wan-14B2024-10-30
DTOS: Dynamic Time Object Sensing with Large Multimodal Model✓ Link74.88DTOS-9B2025-06-11
ViLLa: Video Reasoning Segmentation with Large Language Model✓ Link74.3ViLLa (InternVideo2-6B) (extra data)2024-07-18
Find First, Track Next: Decoupling Identification and Propagation in Referring Video Object Segmentation✓ Link74.269.978.5FindTrack2025-03-05
STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation✓ Link73.670.177.2STAC2026-07-03
Deforming Videos to Masks: Flow Matching for Referring Video Segmentation✓ Link73.3FlowRVS (Wan 2.1 T2V 1.3B DiT, zero-shot) (extra data)2025-10-07
Boosting Text-Driven Video Segmentation via Geometry-Aware Distillation✓ Link72.5GeoLaV2026-06-23
G$^2$TAM: Geometry Grounded Track Anything Model71.768.275.1G2TAM2026-07-04
InterRVOS: Interaction-aware Referring Video Object Segmentation✓ Link71.6ReVIOSa-4B (standard RVOS, AML-only) (extra data)2025-06-03
HyperSeg: Hybrid Segmentation Assistant with Fine-grained Visual Perceiver✓ Link71.2HyperSeg-3B2025-06-11
Temporal-Conditional Referring Video Object Segmentation with Noise-Free Text-to-Video Diffusion Model71.267.575.0HCD2025-08-19
InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models✓ Link71.1InstructSeg (Mipha-3B) (extra data)2024-12-18
SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentation✓ Link70.6SAMWISE (Hiera-B + RoBERTa) (extra data)2024-11-26
VISA: Reasoning Video Object Segmentation via Large Language Models✓ Link70.4VISA Chat-UniVi-13B (extra data)2024-07-16
VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videos✓ Link69.5VideoGLaMM (Phi-3 Mini 3.8B, RVOS fine-tuned) (extra data)2024-11-07
Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object Segmentation✓ Link69.466.272.6VD-IT2024-03-18
One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos✓ Link68.8VideoLISA-3.8B (Post-optimization) (extra data)2024-09-29
Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation✓ Link68.064.871.3MUTR2023-05-25
UniRef++: Segment Every Reference Object in Spatial and Temporal Spaces✓ Link67.2UniRef++-L (joint multi-task, language-only) (extra data)2023-12-25
Tracking Anything with Decoupled Video Segmentation✓ Link66.3DEVA + ReferFormer Swin-L (offline) (extra data)2023-09-07
SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation✓ Link65.862.569.1SOC2023-05-26
MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentation65.061.968.1LMPM++2025-12-11
Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentation✓ Link64.961.768.1DsHmp2024-04-04
OnlineRefer: A Simple Online Baseline for Referring Video Object Segmentation✓ Link64.8OnlineRefer Swin-L (online) (extra data)2023-07-18
LoSh: Long-Short Text Joint Prediction Network for Referring Video Object Segmentation✓ Link64.361.866.8LoSh2023-06-14
Spectrum-guided Multi-granularity Referring Video Object Segmentation✓ Link63.360.666.0SgMg2023-07-25
HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation62.159.265.1HTML2023-01-01
Language as Queries for Referring Video Object Segmentation✓ Link61.158.164.1ReferFormer2022-01-03
Towards Robust Referring Video Object Segmentation with Cyclic Relational Consensus✓ Link59.7R²-VOS (ResNet-50, zero-shot) (extra data)2022-07-04
Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentation✓ Link54.5LBDT2022-06-08
URVOS: Unified Referring Video Object Segmentation Network with a Large-Scale Benchmark✓ Link51.647.356.0URVOS