OpenCodePapers

thermal-image-segmentation-on-mfn-dataset

Semantic SegmentationScene SegmentationThermal Image Segmentation
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodemIOUFrame (fps)ModelNameReleaseDate
RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion62.7RoadFormer+ (ConvNeXt-L)2024-07-31
HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusion✓ Link61.5HAPNet2024-04-04
Complementary Random Masking for RGB-Thermal Semantic Segmentation✓ Link61.4CRM_RGBT_Seg2023-03-30
Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation✓ Link61.3Sigma-base2024-04-05
CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenes✓ Link59.9872.7 (3090)CSFNet-22024-07-01
Delivering Arbitrary-Modal Semantic Segmentation✓ Link59.9CMNeXt (B4)2023-03-02
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers✓ Link59.7CMX (B4)2022-03-09
Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning✓ Link59.3DPLNet2023-12-01
UniRGB-IR: A Unified Framework for RGB-Infrared Semantic Tasks via Adapter Tuning✓ Link59.3UniRGB-IR2024-04-26
Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidance✓ Link59.2SHIFNet2025-03-04
IGFNet: Illumination-Guided Fusion Network for Semantic Scene Understanding using RGB-Thermal Images✓ Link59.0IGFNet(B2)2023-12-04
Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks✓ Link58.9EAEFNet (ResNet-152)2023-03-28
Context-Aware Interaction Network for RGB-T Semantic Segmentation✓ Link58.6%CAINet (MobileNet-V2)2024-01-03
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation✓ Link58.4SpiderMesh (B4)2023-03-15
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers✓ Link58.2CMX (B2)2022-03-09
StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentation✓ Link58.13StitchFusion2024-08-02
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation✓ Link57.9SpiderMesh (ResNet-152)2023-03-15
CACFNet: Cross-Modal Attention Cascaded Fusion Network for RGB-T Urban Scene Parsing57.8CACFNet2023-09-14
Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation57.61VPFNet2023-07-17
EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing✓ Link57.5EGFNet(ConvNeXt)2023-08-15
DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentation57.3DooDLeNet2022-04-21
PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation✓ Link56.5PAIF2023-08-08
Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation56.2RSFNet (ResNet-101)2023-06-17
GEBNet: Graph-Enhancement Branch Network for RGB-T Scene Parsing56.2GEBNet2022-10-31
Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation✓ Link56.1SegMiF2023-08-04
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation✓ Link56.1SpiderMesh (ResNet-101)2023-03-15
MTANet: Multitask-Aware Network With Hierarchical Multimodal Fusion for RGB-T Urban Scene Understanding56.1MTANet2022-04-05
CEKD: Cross-Modal Edge-Privileged Knowledge Distillation for Semantic Scene Understanding Using Only Thermal Images✓ Link56.1CENet2023-02-22
CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenes✓ Link56.05106.3 (3090)CSFNet-12024-07-01
Channel and Spatial Relation-Propagation Network for RGB-Thermal Semantic Segmentation56.0CSRPNet2023-08-24
Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks✓ Link55.9EAFFNet (ResNet-50)2023-03-28
FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentation✓ Link55.3FEANet2021-10-18
RGB-T Semantic Segmentation with Location, Activation, and Sharpening✓ Link54.9LASNet2022-10-26
ABMDRNet: Adaptive-Weighted Bi-Directional Modality Difference Reduction Network for RGB-T Semantic Segmentation54.8ABMDRNet2021-06-19
Edge-aware Guidance Fusion Network for RGB Thermal Scene Parsing✓ Link54.8EGFNet2021-12-09
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers✓ Link54.8SegFormer (B4)2021-05-31
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation✓ Link54.4SpiderMesh (ResNet-50)2023-03-15
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers✓ Link53.2SegFormer (B2)2021-05-31
RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes✓ Link53.2RTFNet2019-03-13
Deep High-Resolution Representation Learning for Visual Recognition✓ Link51.7HRNet2019-08-20
Adaptive Pyramid Context Network for Semantic Segmentation✓ Link49.0APCNet2019-06-01
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows✓ Link49.0SwinT2021-03-25
PST900: RGB-Thermal Calibration, Dataset and Segmentation Network✓ Link48.4PST9002019-09-20
FTNet: Feature Transverse Network for Thermal Image Semantic Segmentation✓ Link47.12FTNet2021-10-26
ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation✓ Link46.3ACNet2019-05-24
Depth-aware CNN for RGB-D Segmentation✓ Link46.1Depth-aware CNN2018-03-19
Pyramid Scene Parsing Network✓ Link46.1PSPNet2016-12-04
Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation✓ Link45.8SA-Gate2020-07-17
U-Net: Convolutional Networks for Biomedical Image Segmentation✓ Link45.1UNet2015-05-18
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes✓ Link44.2FRRN2016-11-24
CCNet: Criss-Cross Attention for Semantic Segmentation✓ Link43.3CCNet2018-11-28
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation✓ Link42.3SegNet2015-11-02
Dual Attention Network for Scene Segmentation✓ Link41.3DANet2018-09-09
MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes39.7MFNet2017-12-14
ERFNet: Efficient Residual Factorized ConvNet for Real-time Semantic Segmentation✓ Link36.1ERFNet2017-10-09