UMG-CLIP: A Unified Multi-Granularity Vision Generalist for Open-World Understanding

Benchmark Model Rank Results
open-vocabulary-panoptic-segmentation-on-ade20kUMG-CLIP-E/14#1PQ: 31.6
open-vocabulary-panoptic-segmentation-on-ade20kUMG-CLIP-L/14#3PQ: 29.1
open-vocabulary-semantic-segmentation-on-pascalvoc-20bUMG-CLIP-E/14#1mIoU: 85.4
open-vocabulary-semantic-segmentation-on-ade20k-847UMG-CLIP-E/14#2mIoU: 17.3
open-vocabulary-semantic-segmentation-on-ade20k-847UMG-CLIP-L/14#7mIoU: 15.4
open-vocabulary-semantic-segmentation-on-pascal-context-459UMG-CLIP-E/14#2mIoU: 25.2
open-vocabulary-semantic-segmentation-on-pascal-context-459UMG-CLIP-L/14#5mIoU: 23.2
open-vocabulary-semantic-segmentation-on-pascalvoc-20UMG-CLIP-L/14#2mIoU: 97.9
open-vocabulary-semantic-segmentation-on-ade20k-150UMG-CLIP-E/14#3mIoU: 38.2
open-vocabulary-semantic-segmentation-on-ade20k-150UMG-CLIP-L/14#9mIoU: 36.1
panoptic-segmentation-on-coco-minivalUMG-CLIP-E/14#5PQ: 59.5AP: 50.7mIoU: 69.7
panoptic-segmentation-on-coco-minivalUMG-CLIP-L/14#8PQ: 58.9AP: 49.7mIoU: 68.9
open-vocabulary-semantic-segmentation-on-pascal-context-59UMG-CLIP-L/14#7mIoU: 61.0