Associating Objects with Transformers for Video Object Segmentation

Benchmark Model Rank Results
video-object-segmentation-on-davis-2017-test-devAOT#1Jaccard: 75.9F-measure: 83.3Mean Jaccard & F-Measure: 79.6
semi-supervised-video-object-segmentation-on-davis-no-youtube-vos-trainingAOT-S#3D17 val (G): 79.2D17 val (J): 76.4D17 val (F): 82.0FPS: 40.0
video-object-segmentation-on-youtube-vos-2019AOT#3Mean Jaccard & F-Measure: 84.1Jaccard (Seen): 83.5…
visual-object-tracking-on-vot2022MS_AOT#3EAO: 0.673
semi-supervised-video-object-segmentation-on-vot2020SwinB-AOT-L#9EAO: 0.586EAO (real-time): 0.523
semi-supervised-video-object-segmentation-on-vot2020AOT-L#11EAO: 0.574EAO (real-time): 0.560
semi-supervised-video-object-segmentation-on-vot2020R50-AOT-L#13EAO: 0.569EAO (real-time): 0.540
semi-supervised-video-object-segmentation-on-vot2020AOT-B#15EAO: 0.541EAO (real-time): 0.533
semi-supervised-video-object-segmentation-on-vot2020AOT-S#16EAO: 0.512EAO (real-time): 0.499
semi-supervised-video-object-segmentation-on-vot2020AOT-T#19EAO: 0.435EAO (real-time): 0.433
video-object-segmentation-on-youtube-vosR50-AOT-L (all frames)#10Overall: 85.5Jaccard (Seen): 84.5Jaccard (Unseen): 79.6…
video-object-segmentation-on-youtube-vosSwinB-AOT-L (all frames)#12Overall: 85.1Jaccard (Seen): 85.1Jaccard (Unseen): 78.4…
video-object-segmentation-on-youtube-vosSwinB-AOT-L#16Overall: 84.5Jaccard (Seen): 84.3Jaccard (Unseen): 77.9…
video-object-segmentation-on-youtube-vosAOT-L (all frames)#17Overall: 84.5Jaccard (Seen): 83.7Jaccard (Unseen): 78.4…
video-object-segmentation-on-youtube-vosR50-AOT-L#21Overall: 84.1Jaccard (Seen): 83.7Jaccard (Unseen): 78.1…
video-object-segmentation-on-youtube-vosAOT-B (all frames)#22Overall: 84.1Jaccard (Seen): 83.6Jaccard (Unseen): 78.0…
video-object-segmentation-on-youtube-vosAOT-L#25Overall: 83.8Jaccard (Seen): 82.9Jaccard (Unseen): 77.7…
video-object-segmentation-on-youtube-vosAOT-B#27Overall: 83.5Jaccard (Seen): 82.6Jaccard (Unseen): 77.7…
video-object-segmentation-on-youtube-vosAOT-S (all frames)#28Overall: 83.0Jaccard (Seen): 82.2Jaccard (Unseen): 77.3…
video-object-segmentation-on-youtube-vosAOT-S#30Overall: 82.6Jaccard (Seen): 82.0Jaccard (Unseen): 76.6…
video-object-segmentation-on-youtube-vosAOT-T (all frames)#38Overall: 80.9Jaccard (Seen): 80.0Jaccard (Unseen): 75.2…
video-object-segmentation-on-youtube-vosAOT-T#39Overall: 80.2Jaccard (Seen): 80.1Jaccard (Unseen): 74.0…
visual-object-tracking-on-davis-2016SwinB-AOT-L#10J&F: 92.0Jaccard (Mean): 90.7F-measure (Mean): 93.3…
visual-object-tracking-on-davis-2016R50-AOT-L#17J&F: 91.1Jaccard (Mean): 90.1F-measure (Mean): 92.1…
visual-object-tracking-on-davis-2016AOT-L#24J&F: 90.4Jaccard (Mean): 89.6F-measure (Mean): 91.1…
visual-object-tracking-on-davis-2016AOT-L#27J&F: 89.9Jaccard (Mean): 88.7F-measure (Mean): 91.1…
visual-object-tracking-on-davis-2016AOT-S#30J&F: 89.4Jaccard (Mean): 88.6F-measure (Mean): 90.2…
visual-object-tracking-on-davis-2016AOT-T#39J&F: 86.8Jaccard (Mean): 86.1F-measure (Mean): 87.4…
semi-supervised-video-object-segmentation-on-davis-2017-test-devSwinB-AOT-L#13J&F: 81.2Jaccard (Mean): 77.3F-measure (Mean): 85.1FPS: 12.1
semi-supervised-video-object-segmentation-on-davis-2017-test-devR50-AOT-L#21J&F: 79.6Jaccard (Mean): 75.9F-measure (Mean): 83.3FPS: 18.0
semi-supervised-video-object-segmentation-on-davis-2017-test-devAOT-L#24J&F: 78.3Jaccard (Mean): 74.3F-measure (Mean): 82.3FPS: 18.7
semi-supervised-video-object-segmentation-on-davis-2017-test-devAOT-B#31J&F: 75.5Jaccard (Mean): 71.6F-measure (Mean): 79.3FPS: 29.6
semi-supervised-video-object-segmentation-on-davis-2017-test-devAOT-S#35J&F: 73.9Jaccard (Mean): 70.3F-measure (Mean): 77.5FPS: 40.0
semi-supervised-video-object-segmentation-on-davis-2017-test-devAOT-T#38J&F: 72.0Jaccard (Mean): 68.3F-measure (Mean): 75.7FPS: 51.4
semi-supervised-video-object-segmentation-on-moseAOT#19J&F: 57.2J: 53.1F: 61.3
visual-object-tracking-on-davis-2017SwinB-AOT-L#21J&F: 85.4Jaccard (Mean): 82.4F-measure (Mean): 88.4…
visual-object-tracking-on-davis-2017R50-AOT-L#26J&F: 84.9Jaccard (Mean): 82.3F-measure (Mean): 87.5…
visual-object-tracking-on-davis-2017AOT-L#32J&F: 83.8Jaccard (Mean): 81.1F-measure (Mean): 86.4…
visual-object-tracking-on-davis-2017AOT-B#38J&F: 82.5Jaccard (Mean): 79.7F-measure (Mean): 85.2…
visual-object-tracking-on-davis-2017AOT-S#42J&F: 81.3Jaccard (Mean): 78.7F-measure (Mean): 83.9…
visual-object-tracking-on-davis-2017AOT-T#45J&F: 79.9Jaccard (Mean): 77.4F-measure (Mean): 82.3…