Single Frame Semantic Segmentation Using Multi-Modal Spherical Images

Benchmark Model Rank Results
semantic-segmentation-on-matterport3dSFSS-MMSI (RGB+Depth)#1Test mIoU: 35.92Validation mIoU: 39.19
semantic-segmentation-on-matterport3dSFSS-MMSI (RGB+Normal)#2Test mIoU: 35.77Validation mIoU: 38.91
semantic-segmentation-on-matterport3dSFSS-MMSI (RGB+Depth+Normal)#3Test mIoU: 35.52Validation mIoU: 39.26
semantic-segmentation-on-matterport3dSFSS-MMSI (RGB Only)#4Test mIoU: 31.3Validation mIoU: 35.15
semantic-segmentation-on-stanford2d3d-1SFSS-MMSI (RGB+HHA)#1mIoU: 60.6%mAcc: 70.68
semantic-segmentation-on-stanford2d3d-1SFSS-MMSI (RGB+Depth+Normal)#2mIoU: 59.43%mAcc: 69.03
semantic-segmentation-on-stanford2d3d-1SFSS-MMSI (RGB+Normal)#3mIoU: 58.24%mAcc: 68.79
semantic-segmentation-on-stanford2d3d-1SFSS-MMSI (RGB+Depth)#5mIoU: 55.49%mAcc: 68.57
semantic-segmentation-on-stanford2d3d-1SFSS-MMSI (RGB Only)#9mIoU: 52.87%mAcc: 63.96
semantic-segmentation-on-structured3dSFSS-MMSI (RGB+Depth+Normal)#1Test mIoU: 71.97Validation mIoU: 75.86
semantic-segmentation-on-structured3dSFSS-MMSI (RGB+Normal)#2Test mIoU: 71Validation mIoU: 74.38
semantic-segmentation-on-structured3dSFSS-MMSI (RGB+Depth)#3Test mIoU: 70.17Validation mIoU: 73.78
semantic-segmentation-on-structured3dSFSS-MMSI (RGB Only)#4Test mIoU: 68.34Validation mIoU: 71.94