USB: Universal-Scale Object Detection Benchmark

Benchmark Model Rank Results
object-detection-on-manga109-s-15testYOLOX-L#1COCO-style AP: 70.2
object-detection-on-manga109-s-15testUniverseNet-20.08#2COCO-style AP: 69.9
object-detection-on-manga109-s-15testUniverseNet#3COCO-style AP: 68.9
object-detection-on-manga109-s-15testATSS+DyHead#4COCO-style AP: 67.9
object-detection-on-manga109-s-15testCascade R-CNN#5COCO-style AP: 67.6
object-detection-on-manga109-s-15testATSS (ConvNeXt-T)#6COCO-style AP: 67.4
object-detection-on-manga109-s-15testGFL#7COCO-style AP: 67.3
object-detection-on-manga109-s-15testATSS+SEPC#8COCO-style AP: 67.1
object-detection-on-manga109-s-15testATSS#9COCO-style AP: 66.5
object-detection-on-manga109-s-15testATSS (Swin-T)#10COCO-style AP: 66.2
object-detection-on-manga109-s-15testFaster R-CNN#11COCO-style AP: 65.8
object-detection-on-manga109-s-15testRetinaNet#12COCO-style AP: 65.3
object-detection-on-manga109-s-15testDeformable DETR#13COCO-style AP: 64.1
object-detection-on-manga109-s-15testSparse R-CNN#14COCO-style AP: 63.1
object-detection-on-manga109-s-15testDETR#15COCO-style AP: 31.2
object-detection-on-usb-standard-usb-1-0-protocolUniverseNet-20.08#1mCAP: 52.1
object-detection-on-usb-standard-usb-1-0-protocolUniverseNet#2mCAP: 51.4
object-detection-on-usb-standard-usb-1-0-protocolATSS (ConvNeXt-T)#3mCAP: 50.4
object-detection-on-usb-standard-usb-1-0-protocolYOLOX-L#4mCAP: 49.6
object-detection-on-usb-standard-usb-1-0-protocolATSS+DyHead#5mCAP: 49.4
object-detection-on-usb-standard-usb-1-0-protocolATSS (Swin-T)#6mCAP: 49.0
object-detection-on-usb-standard-usb-1-0-protocolCascade R-CNN#7mCAP: 48.1
object-detection-on-usb-standard-usb-1-0-protocolGFL#8mCAP: 47.7
object-detection-on-usb-standard-usb-1-0-protocolATSS#9mCAP: 47.1
object-detection-on-usb-standard-usb-1-0-protocolFaster R-CNN#10mCAP: 45.9
object-detection-on-usb-standard-usb-1-0-protocolRetinaNet#11mCAP: 44.8
object-detection-on-usb-standard-usb-1-0-protocolSparse R-CNN#12mCAP: 44.6
object-detection-on-usb-standard-usb-1-0-protocolDETR#13mCAP: 23.7
object-detection-on-waymo-2d-detection-all-ns-f0valYOLOX-L#1COCO-style AP: 41.6
object-detection-on-waymo-2d-detection-all-ns-f0valUniverseNet-20.08#2COCO-style AP: 39.0
object-detection-on-waymo-2d-detection-all-ns-f0valUniverseNet#3COCO-style AP: 38.6
object-detection-on-waymo-2d-detection-all-ns-f0valATSS (ConvNeXt-T)#4COCO-style AP: 38.3
object-detection-on-waymo-2d-detection-all-ns-f0valATSS (Swin-T)#5COCO-style AP: 37.2
object-detection-on-waymo-2d-detection-all-ns-f0valATSS+DyHead#6COCO-style AP: 37.1
object-detection-on-waymo-2d-detection-all-ns-f0valCascade R-CNN#7COCO-style AP: 36.4
object-detection-on-waymo-2d-detection-all-ns-f0valGFL#8COCO-style AP: 35.7
object-detection-on-waymo-2d-detection-all-ns-f0valATSS#9COCO-style AP: 35.4
object-detection-on-waymo-2d-detection-all-ns-f0valATSS+SEPC#10COCO-style AP: 35.0
object-detection-on-waymo-2d-detection-all-ns-f0valFaster R-CNN#11COCO-style AP: 34.5
object-detection-on-waymo-2d-detection-all-ns-f0valSparse R-CNN#12COCO-style AP: 32.8
object-detection-on-waymo-2d-detection-all-ns-f0valDeformable DETR#13COCO-style AP: 32.7
object-detection-on-waymo-2d-detection-all-ns-f0valRetinaNet#14COCO-style AP: 32.5
object-detection-on-waymo-2d-detection-all-ns-f0valDETR#15COCO-style AP: 17.8
object-detection-on-coco-oUniverseNet (R2-101-DCN)#28Average mAP: 24.8
object-detection-on-coco-oUniverseNet (R2-101-DCN)#44Effective Robustness: 1.86
object-detection-on-coco-test-devUniverseNet-20.08d (Res2Net-101, DCN, multi-scale)#55box mAP: 54.1AP50: 71.6AP75: 59.9APS: 35.8APM: 57.2APL: 67.4
object-detection-on-coco-test-devUniverseNet-20.08d (Res2Net-101, DCN, single-scale)#76box mAP: 51.3AP50: 70.0AP75: 55.8APS: 31.7APM: 55.3APL: 64.9
object-detection-on-coco-test-devUniverseNet-20.08 (Res2Net-50, DCN, single-scale)#95box mAP: 48.8AP50: 67.5AP75: 53.0APS: 30.1APM: 52.3APL: 61.1
object-detection-on-coco-val2017UniverseNet-20.08d (Res2Net-50, DCN)#251box AP: 48.6AP50: 67.1AP75: 52.7APS: 30.1APM: 53.0APL: 63.8