SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset

Benchmark Model Rank Results
3d-object-detection-on-simbevUniTR+LSS#1SDS: 0.622mAP: 0.478mATE: 0.113mAOE: 0.207mASE: 0.085
3d-object-detection-on-simbevUniTR#2SDS: 0.617mAP: 0.477mATE: 0.113mAOE: 0.224mASE: 0.09
3d-object-detection-on-simbevBEVFusion#3SDS: 0.566mAP: 0.481mATE: 0.146mAOE: 0.122mASE: 0.127
3d-object-detection-on-simbevBEVFusion-L#4SDS: 0.564mAP: 0.481mATE: 0.144mAOE: 0.133mASE: 0.134
3d-object-detection-on-simbevBEVFusion-C#5SDS: 0.251mAP: 0.221mATE: 0.744mAOE: 1.044mASE: 0.137
bev-segmentation-on-simbevBEVFusion#1mIoU: 0.5road: 0.884car: 0.727truck: 0.745bus: 0.8
bev-segmentation-on-simbevUniTR#2mIoU: 0.497road: 0.928car: 0.738truck: 0.677bus: 0.517
bev-segmentation-on-simbevBEVFusion-L#3mIoU: 0.483road: 0.877car: 0.706truck: 0.735bus: 0.815
bev-segmentation-on-simbevUniTR+LSS#4mIoU: 0.476road: 0.933car: 0.728truck: 0.694bus: 0.585
bev-segmentation-on-simbevBEVFusion-C#5mIoU: 0.152road: 0.76car: 0.172truck: 0.051bus: 0.229
bird-s-eye-view-semantic-segmentation-on-1BEVFusion#1mIoU: 0.5road: 0.884car: 0.727truck: 0.745bus: 0.808
bird-s-eye-view-semantic-segmentation-on-1UniTR#2mIoU: 0.497road: 0.928car: 0.738truck: 0.677bus: 0.517
bird-s-eye-view-semantic-segmentation-on-1BEVFusion-L#3mIoU: 0.483road: 0.877car: 0.706truck: 0.735bus: 0.815
bird-s-eye-view-semantic-segmentation-on-1UniTR+LSS#4mIoU: 0.476road: 0.933car: 0.728truck: 0.694bus: 0.585
bird-s-eye-view-semantic-segmentation-on-1BEVFusion-C#5mIoU: 0.152road: 0.76car: 0.172truck: 0.051bus: 0.229