OpenCodePapers

open-vocabulary-semantic-segmentation-on-ade20k-847

Semantic SegmentationOpen Vocabulary Semantic Segmentation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodemIoUModelNameReleaseDate
dinov3.seg: Open-Vocabulary Semantic Segmentation with DINOv320.09dinov3.seg2026-03-19
PCA-Seg: Revisiting Cost Aggregation for Open-Vocabulary Semantic and Part Segmentation✓ Link18.3PCA-Seg (ViT-L/14)2026-03-18
UMG-CLIP: A Unified Multi-Granularity Vision Generalist for Open-World Understanding✓ Link17.3UMG-CLIP-E/142024-01-12
MaskCLIP++: A Mask-Based CLIP Fine-tuning Framework for Open-Vocabulary Image Segmentation✓ Link16.8MaskCLIP++2024-12-16
InfoCLIP: Bridging Vision-Language Pretraining and Open-Vocabulary Semantic Segmentation via Information-Theoretic Alignment Transfer16.6InfoCLIP (CLIP ViT-L/14)2025-11-20
EOVSAM: Efficient Open-Vocabulary Segmentation with SAM 3 in One Pass16.6EOVSAM2026-08-03
DCP-CLIP:A Coarse-to-Fine Framework for Open-Vocabulary Semantic Segmentation with Dual Interaction16.4DCP-CLIP (CLIP ViT-L/14)2026-03-14
DiSa: Saliency-Aware Foreground-Background Disentangled Framework for Open-Vocabulary Semantic Segmentation16.3DiSa (CLIP ViT-L/14)2026-01-27
Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentation✓ Link16.2Mask-Adapter2024-12-05
PCA-Seg: Revisiting Cost Aggregation for Open-Vocabulary Semantic and Part Segmentation✓ Link16.1PCA-Seg (ViT-B/16)2026-03-18
CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation✓ Link16.0CAT-Seg2023-03-21
Novel Category Discovery with X-Agent Attention for Open-Vocabulary Semantic Segmentation16.0X-Agent (CLIP ViT-L/14)2025-09-01
UMG-CLIP: A Unified Multi-Granularity Vision Generalist for Open-World Understanding✓ Link15.4UMG-CLIP-L/142024-01-12
Collaborative Vision-Text Representation Optimizing for Open-Vocabulary Segmentation✓ Link15.1MAFT+2024-08-01
SILC: Improving Vision Language Pretraining with Self-Distillation15.0SILC2023-10-20
PosSAM: Panoptic Open-vocabulary Segment Anything✓ Link14.9PosSAM2024-03-14
Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIP✓ Link14.8FC-CLIP2023-08-04
Open-Vocabulary Segmentation with Semantic-Assisted Calibration✓ Link14.0SCAN2023-12-07
Mitigating Objectness Bias and Region-to-Text Misalignment for Open-Vocabulary Panoptic Segmentation✓ Link14.0OVRCOAT2026-03-22
SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentation✓ Link13.9SED2023-11-27
Side Adapter Network for Open-Vocabulary Semantic Segmentation✓ Link13.7SAN2023-02-23
Open-Vocabulary Semantic Segmentation with Image Embedding Balancing✓ Link13.7EBSeg-L2024-06-14
InfoCLIP: Bridging Vision-Language Pretraining and Open-Vocabulary Semantic Segmentation via Information-Theoretic Alignment Transfer12.6InfoCLIP (CLIP ViT-B/16)2025-11-20
DiSa: Saliency-Aware Foreground-Background Disentangled Framework for Open-Vocabulary Semantic Segmentation12.6DiSa (CLIP ViT-B/16)2026-01-27
CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction✓ Link12.4CLIPSelf2023-10-02
DCP-CLIP:A Coarse-to-Fine Framework for Open-Vocabulary Semantic Segmentation with Dual Interaction12.3DCP-CLIP (CLIP ViT-B/16)2026-03-14
Learning Mask-aware CLIP Representations for Zero-Shot Segmentation✓ Link12.1MAFT-ViTL2023-09-30
Novel Category Discovery with X-Agent Attention for Open-Vocabulary Semantic Segmentation11.9X-Agent (CLIP ViT-B/16)2025-09-01
Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models✓ Link11.1ODISE2023-03-08
Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP✓ Link9OVSeg Swin-B2022-10-09
Open-Vocabulary Universal Image Segmentation with MaskCLIP✓ Link8.2MaskCLIP2022-08-18
A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Model✓ Link7SimSeg2021-12-29