CheXGenBench: A Unified Benchmark For Fidelity, Privacy and Utility of Synthetic Chest Radiographs

Open paper
Benchmark Model Rank Results
conditional-text-to-image-synthesis-on-mimic-cxrSana#1FID (RadDino): 54.22
conditional-text-to-image-synthesis-on-mimic-cxrPixart Sigma#2FID (RadDino): 60.15
conditional-text-to-image-synthesis-on-mimic-cxrRadEdit#3FID (RadDino): 69.69
conditional-text-to-image-synthesis-on-mimic-cxrLLM-CXR#4FID (RadDino): 71.24
conditional-text-to-image-synthesis-on-mimic-cxrSD V3.5 Medium (LoRA r128)#5FID (RadDino): 74.58
conditional-text-to-image-synthesis-on-mimic-cxrLumina 2.0 (LoRA r128)#6FID (RadDino): 88.28
conditional-text-to-image-synthesis-on-mimic-cxrSD V3.5 Medium (LoRA r32)#7FID (RadDino): 93.10
conditional-text-to-image-synthesis-on-mimic-cxrLumina 2.0 (LoRA r32)#8FID (RadDino): 101.19
conditional-text-to-image-synthesis-on-mimic-cxrSD V1-5#9FID (RadDino): 118.93
conditional-text-to-image-synthesis-on-mimic-cxrFlux.1-Dev (LoRA r32)#10FID (RadDino): 122.40
conditional-text-to-image-synthesis-on-mimic-cxrSD V1-4#11FID (RadDino): 125.18
conditional-text-to-image-synthesis-on-mimic-cxrSD V2-1#12FID (RadDino): 186.53
conditional-text-to-image-synthesis-on-mimic-cxrSD V2#13FID (RadDino): 194.72

Rank counts only results with a code link.