OpenCodePapers

multispectral-object-detection-on-flir-1

Multispectral Object Detection
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodemAP50mAPModelNameReleaseDate
When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Dataset✓ Link86.4%MMPedestron2024-07-14
RGB-X Object Detection via Scene-Specific Fusion Modules✓ Link86.16%47.1%RGB-X Scene Adaptive CBAM2023-10-30
CAFF-DINO: Multi-spectral object detection transformers with cross-attention features fusion85.5%50.5%CAFF-DINO2024-09-27
Removal then Selection: A Coarse-to-Fine Fusion Perspective for RGB-Infrared Object Detection✓ Link83.9%43.8%RSDet2024-01-19
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers✓ Link82.2%CMX2022-03-09
UniRGB-IR: A Unified Framework for RGB-Infrared Semantic Tasks via Adapter Tuning✓ Link81.4%44.1%UniRGB-IR2024-04-26
MiPa: Mixed Patch Infrared-Visible Modality Agnostic Object Detection✓ Link81.3%44.8%MiPa2024-04-29
Multimodal Object Detection by Channel Switching and Spatial Attention79.2%41.3%CSSA2023-06-18
Cross-Modality Fusion Transformer for Multispectral Object Detection✓ Link77.7%CFT2021-10-30
Multimodal Object Detection by Channel Switching and Spatial Attention75.5%37.9%ProbEn2023-06-18
Multimodal Object Detection by Channel Switching and Spatial Attention74.6%37.4%GAFF2023-06-18
Cross-Modality Fusion Transformer for Multispectral Object Detection✓ Link73.9%YOLOv5 (T)2021-10-30
Guided Attentive Feature Fusion for Multispectral Pedestrian Detection✓ Link72.9%GAFF (ResNet18)2021-01-03
Guided Attentive Feature Fusion for Multispectral Pedestrian Detection✓ Link72.7%GAFF (VGG16)2021-01-03
Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks✓ Link72.4%CFR_3 (VGG16)2020-09-26
Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks✓ Link71.2%Halfway Fusion (VGG16)2020-09-26
Cross-Modality Fusion Transformer for Multispectral Object Detection✓ Link67.8%YOLOv5 (RGB)2021-10-30
Multimodal Object Detection by Channel Switching and Spatial Attention35.8%Halfway Fusion2023-06-18