XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model

Benchmark Model Rank Results
semi-supervised-video-object-segmentation-on-1XMem (BL30K, MS)#6J&F: 83.7Jaccard (Mean): 80.5F-measure (Mean): 87.0
semi-supervised-video-object-segmentation-on-1XMem (MS)#8J&F: 83.1Jaccard (Mean): 79.7F-measure (Mean): 86.4
semi-supervised-video-object-segmentation-on-1XMem (BL30K, 600p)#11J&F: 82.5Jaccard (Mean): 79.1F-measure (Mean): 85.8
semi-supervised-video-object-segmentation-on-1XMem (BL30K)#14J&F: 81.2Jaccard (Mean): 77.6F-measure (Mean): 84.7
semi-supervised-video-object-segmentation-on-1XMem#16J&F: 81.0Jaccard (Mean): 77.4F-measure (Mean): 84.5
semi-supervised-video-object-segmentation-on-1XMem (DAVIS and YouTubeVOS only)#20J&F: 79.8Jaccard (Mean): 76.3F-measure (Mean): 83.4
semi-supervised-video-object-segmentation-on-13XMem#1J&F: 89.8±0.2J: 88.0±0.2F: 91.6±0.2
semi-supervised-video-object-segmentation-on-18XMem (BL30K, MS)#2Overall: 86.8Jaccard (Seen): 85.5F-Measure (Seen): 89.8
semi-supervised-video-object-segmentation-on-18XMem (MS)#4Overall: 86.4Jaccard (Seen): 84.9F-Measure (Seen): 89.2
semi-supervised-video-object-segmentation-on-18XMem (BL30K)#8Overall: 85.8Jaccard (Seen): 84.8F-Measure (Seen): 89.2
semi-supervised-video-object-segmentation-on-18XMem#15Overall: 84.3Jaccard (Seen): 83.6F-Measure (Seen): 88.0
semi-supervised-video-object-segmentation-on-20XMem#22FPS: 29.6
semi-supervised-video-object-segmentation-on-21XMem#13J&F: 57.6J: 53.3F: 62.0
video-object-segmentation-on-davis-2016XMem (BL30K, MS)#1J&F: 93.3F-Score: 94.4Jaccard (Mean): 92.2
video-object-segmentation-on-davis-2016XMem#2J&F: 91.5F-Score: 92.7Jaccard (Mean): 90.4
video-object-segmentation-on-davis-2017-valXMem (BLK30K, MS)#1Mean Jaccard & F-Measure: 89.5F-measure: 92.6Jaccard: 86.3
video-object-segmentation-on-davis-2017-valXMem#2Mean Jaccard & F-Measure: 86.2F-measure: 89.5Jaccard: 82.9
video-object-segmentation-on-m-3-vosXMem#3Average IOU: 70.4
video-object-segmentation-on-youtube-vosXMem (BL30K, MS)#2Overall: 86.9Jaccard (Seen): 85.6Jaccard (Unseen): 81.7
video-object-segmentation-on-youtube-vosXMem (MS)#3Overall: 86.7Jaccard (Seen): 85.3Jaccard (Unseen): 81.7
video-object-segmentation-on-youtube-vosXMem (BL30K)#6Overall: 86.1Jaccard (Seen): 85.1Jaccard (Unseen): 80.3
video-object-segmentation-on-youtube-vosXMem#9Overall: 85.7Jaccard (Seen): 84.6Jaccard (Unseen): 80.2
video-object-segmentation-on-youtube-vosXMem (YouTubeVOS only)#19Overall: 84.4Jaccard (Seen): 83.7Jaccard (Unseen): 78.2
video-object-segmentation-on-youtube-vos-1XMem (BL30K, MS)#1Mean Jaccard & F-Measure: 86.9Jaccard (Seen): 85.6
video-object-segmentation-on-youtube-vos-2019-2XMem (BL30K,MS)#1Mean Jaccard & F-Measure: 86.8Jaccard (Seen): 85.5
video-object-segmentation-on-youtube-vos-2019-2XMem#2Mean Jaccard & F-Measure: 85.5Jaccard (Seen): 84.3
visual-object-tracking-on-davis-2016XMem (BL30K, MS)#1J&F: 93.3Jaccard (Mean): 92.2F-measure (Mean): 94.4
visual-object-tracking-on-davis-2016XMem (MS)#5J&F: 92.7Jaccard (Mean): 92.0F-measure (Mean): 93.5
visual-object-tracking-on-davis-2016XMem (BL30K)#12J&F: 92.0Jaccard (Mean): 90.7F-measure (Mean): 93.2
visual-object-tracking-on-davis-2016XMem#16J&F: 91.5Jaccard (Mean): 90.4F-measure (Mean): 92.7
visual-object-tracking-on-davis-2016XMem (DAVIS+YouTubeVOS only)#21J&F: 90.8Jaccard (Mean): 89.6F-measure (Mean): 91.9
visual-object-tracking-on-davis-2016XMem (DAVIS only)#36J&F: 87.8Jaccard (Mean): 86.7F-measure (Mean): 88.9
visual-object-tracking-on-davis-2017XMem (BL30K, MS)#3J&F: 89.5Jaccard (Mean): 86.3F-measure (Mean): 92.6
visual-object-tracking-on-davis-2017XMem (MS)#4J&F: 88.2Jaccard (Mean): 85.4F-measure (Mean): 91.0
visual-object-tracking-on-davis-2017XMem (BL30K)#7J&F: 87.7Jaccard (Mean): 84.0F-measure (Mean): 91.4
visual-object-tracking-on-davis-2017XMem#12J&F: 86.2Jaccard (Mean): 82.9F-measure (Mean): 89.5
visual-object-tracking-on-davis-2017XMem (DAVIS and YouTubeVOS only)#24J&F: 84.5Jaccard (Mean): 81.4F-measure (Mean): 87.6
visual-object-tracking-on-davis-2017XMem (DAVIS only)#46J&F: 76.7Jaccard (Mean): 74.1F-measure (Mean): 79.3