Associating Objects with Transformers for Video Object Segmentation

Benchmark Model Rank Results
semi-supervised-video-object-segmentation-on-1SwinB-AOT-L#13J&F: 81.2Jaccard (Mean): 77.3F-measure (Mean): 85.1FPS: 12.1
semi-supervised-video-object-segmentation-on-1R50-AOT-L#21J&F: 79.6Jaccard (Mean): 75.9F-measure (Mean): 83.3FPS: 18.0
semi-supervised-video-object-segmentation-on-1AOT-L#24J&F: 78.3Jaccard (Mean): 74.3F-measure (Mean): 82.3FPS: 18.7
semi-supervised-video-object-segmentation-on-1AOT-B#31J&F: 75.5Jaccard (Mean): 71.6F-measure (Mean): 79.3FPS: 29.6
semi-supervised-video-object-segmentation-on-1AOT-S#35J&F: 73.9Jaccard (Mean): 70.3F-measure (Mean): 77.5FPS: 40.0
semi-supervised-video-object-segmentation-on-1AOT-T#38J&F: 72.0Jaccard (Mean): 68.3F-measure (Mean): 75.7FPS: 51.4
semi-supervised-video-object-segmentation-on-15SwinB-AOT-L#9EAO: 0.586EAO (real-time): 0.523
semi-supervised-video-object-segmentation-on-15AOT-L#11EAO: 0.574EAO (real-time): 0.560
semi-supervised-video-object-segmentation-on-15R50-AOT-L#13EAO: 0.569EAO (real-time): 0.540
semi-supervised-video-object-segmentation-on-15AOT-B#15EAO: 0.541EAO (real-time): 0.533
semi-supervised-video-object-segmentation-on-15AOT-S#16EAO: 0.512EAO (real-time): 0.499
semi-supervised-video-object-segmentation-on-15AOT-T#19EAO: 0.435EAO (real-time): 0.433
semi-supervised-video-object-segmentation-on-20AOT-S#3D17 val (G): 79.2D17 val (J): 76.4D17 val (F): 82.0FPS: 40.0
semi-supervised-video-object-segmentation-on-21AOT#14J&F: 57.2J: 53.1F: 61.3
video-object-segmentation-on-davis-2017-test-1AOT#1Jaccard: 75.9F-measure: 83.3Mean Jaccard & F-Measure: 79.6
video-object-segmentation-on-youtube-vosR50-AOT-L (all frames)#10Overall: 85.5Jaccard (Seen): 84.5Jaccard (Unseen): 79.6
video-object-segmentation-on-youtube-vosSwinB-AOT-L (all frames)#12Overall: 85.1Jaccard (Seen): 85.1Jaccard (Unseen): 78.4
video-object-segmentation-on-youtube-vosSwinB-AOT-L#16Overall: 84.5Jaccard (Seen): 84.3Jaccard (Unseen): 77.9
video-object-segmentation-on-youtube-vosAOT-L (all frames)#17Overall: 84.5Jaccard (Seen): 83.7Jaccard (Unseen): 78.4
video-object-segmentation-on-youtube-vosR50-AOT-L#21Overall: 84.1Jaccard (Seen): 83.7Jaccard (Unseen): 78.1
video-object-segmentation-on-youtube-vosAOT-B (all frames)#22Overall: 84.1Jaccard (Seen): 83.6Jaccard (Unseen): 78.0
video-object-segmentation-on-youtube-vosAOT-L#25Overall: 83.8Jaccard (Seen): 82.9Jaccard (Unseen): 77.7
video-object-segmentation-on-youtube-vosAOT-B#27Overall: 83.5Jaccard (Seen): 82.6Jaccard (Unseen): 77.7
video-object-segmentation-on-youtube-vosAOT-S (all frames)#28Overall: 83.0Jaccard (Seen): 82.2Jaccard (Unseen): 77.3
video-object-segmentation-on-youtube-vosAOT-S#30Overall: 82.6Jaccard (Seen): 82.0Jaccard (Unseen): 76.6
video-object-segmentation-on-youtube-vosAOT-T (all frames)#38Overall: 80.9Jaccard (Seen): 80.0Jaccard (Unseen): 75.2
video-object-segmentation-on-youtube-vosAOT-T#39Overall: 80.2Jaccard (Seen): 80.1Jaccard (Unseen): 74.0
video-object-segmentation-on-youtube-vos-2019-2AOT#3Mean Jaccard & F-Measure: 84.1Jaccard (Seen): 83.5
visual-object-tracking-on-davis-2016SwinB-AOT-L#10J&F: 92.0Jaccard (Mean): 90.7F-measure (Mean): 93.3
visual-object-tracking-on-davis-2016R50-AOT-L#17J&F: 91.1Jaccard (Mean): 90.1F-measure (Mean): 92.1
visual-object-tracking-on-davis-2016AOT-L#24J&F: 90.4Jaccard (Mean): 89.6F-measure (Mean): 91.1
visual-object-tracking-on-davis-2016AOT-L#27J&F: 89.9Jaccard (Mean): 88.7F-measure (Mean): 91.1
visual-object-tracking-on-davis-2016AOT-S#30J&F: 89.4Jaccard (Mean): 88.6F-measure (Mean): 90.2
visual-object-tracking-on-davis-2016AOT-T#39J&F: 86.8Jaccard (Mean): 86.1F-measure (Mean): 87.4
visual-object-tracking-on-davis-2017SwinB-AOT-L#16J&F: 85.4Jaccard (Mean): 82.4F-measure (Mean): 88.4
visual-object-tracking-on-davis-2017R50-AOT-L#21J&F: 84.9Jaccard (Mean): 82.3F-measure (Mean): 87.5
visual-object-tracking-on-davis-2017AOT-L#26J&F: 83.8Jaccard (Mean): 81.1F-measure (Mean): 86.4
visual-object-tracking-on-davis-2017AOT-B#32J&F: 82.5Jaccard (Mean): 79.7F-measure (Mean): 85.2
visual-object-tracking-on-davis-2017AOT-S#36J&F: 81.3Jaccard (Mean): 78.7F-measure (Mean): 83.9
visual-object-tracking-on-davis-2017AOT-T#39J&F: 79.9Jaccard (Mean): 77.4F-measure (Mean): 82.3
visual-object-tracking-on-vot2022MS_AOT#3EAO: 0.673