Saliency-Guided DETR for Moment Retrieval and Highlight Detection

Benchmark Model Rank Results
highlight-detection-on-qvhighlightsSG-DETR (w/ PT)#1mAP: 44.70Hit@1: 71.00
highlight-detection-on-qvhighlightsSG-DETR#3mAP: 43.76Hit@1: 69.13
highlight-detection-on-tvsumSG-DETR#2mAP: 87.1
highlight-detection-on-youtube-highlightsSG-DETR (w/ PT)#1mAP: 78.0
highlight-detection-on-youtube-highlightsSG-DETR#3mAP: 76.7
moment-retrieval-on-charades-staSG-DETR (w/ PT)#1R@1 IoU=0.5: 71.10R@1 IoU=0.7: 52.80
moment-retrieval-on-charades-staSG-DETR#4R@1 IoU=0.5: 70.20R@1 IoU=0.7: 49.50
moment-retrieval-on-qvhighlightsSG-DETR (w/ PT)#1mAP: 58.80R@1 IoU=0.5: 74.20R@1 IoU=0.7: 60.40mAP@0.5: 76.20
moment-retrieval-on-qvhighlightsSG-DETR#2mAP: 54.10R@1 IoU=0.5: 72.20R@1 IoU=0.7: 56.60mAP@0.5: 73.20
natural-language-moment-retrieval-on-tacosSG-DETR (w/ PT)#1R@1,IoU=0.3: 58.10R@1,IoU=0.5: 46.40R@1,IoU=0.7: 33.90mIoU: 42.40
natural-language-moment-retrieval-on-tacosSG-DETR#4R@1,IoU=0.3: 56.71R@1,IoU=0.5: 44.70R@1,IoU=0.7: 29.90mIoU: 40.90