Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification

Benchmark Model Rank Results
medical-code-prediction-on-mimic-iv-icd-10-fullMSMN#1Macro-AUC: 97.07Micro-AUC: 99.61Macro-F1: 5.42Micro-F1: 55.91…
medical-code-prediction-on-mimic-iv-icd-10-fullJoint LAAT#2Macro-AUC: 93.64Micro-AUC: 99.27Macro-F1: 5.71Micro-F1: 55.89…
medical-code-prediction-on-mimic-iv-icd-10-fullLAAT#3Macro-AUC: 92.96Micro-AUC: 99.14Macro-F1: 4.47Micro-F1: 55.40…
medical-code-prediction-on-mimic-iv-icd-10-fullPLM#4Macro-AUC: 91.85Micro-AUC: 99.02Macro-F1: 4.90Micro-F1: 56.95…
medical-code-prediction-on-mimic-iv-icd-10-fullCAML#5Macro-AUC: 89.91Micro-AUC: 98.79Macro-F1: 4.07Micro-F1: 52.67…
medical-code-prediction-on-mimic-iv-icd10-top50MSMN#1F1 (micro): 74.15F1 (macro): 69.01AUC (Micro): 95.61…
medical-code-prediction-on-mimic-iv-icd10-top50PLM-ICD#2F1 (micro): 73.27F1 (macro): 70.31AUC (Micro): 95.69…
medical-code-prediction-on-mimic-iv-icd10-top50Joint LAAT#3F1 (micro): 72.85F1 (macro): 68.41AUC (Micro): 95.57…
medical-code-prediction-on-mimic-iv-icd10-top50LAAT#4F1 (micro): 72.56F1 (macro): 68.15AUC (Micro): 95.49…
medical-code-prediction-on-mimic-iv-icd10-top50CAML#5F1 (micro): 67.56F1 (macro): 64.30AUC (Micro): 93.18…
medical-code-prediction-on-mimic-iv-icd9-fullMSMN#1Macro AUC: 96.79Micro AUC: 99.56F1 Macro: 13.94F1 Micro: 61.15…
medical-code-prediction-on-mimic-iv-icd9-fullPLM-ICD#2Macro AUC: 96.61Micro AUC: 99.53F1 Macro: 14.40F1 Micro: 62.45…
medical-code-prediction-on-mimic-iv-icd9-fullJoint LAAT#3Macro AUC: 95.57Micro AUC: 99.49F1 Macro: 14.17F1 Micro: 60.37…
medical-code-prediction-on-mimic-iv-icd9-fullLAAT#4Macro AUC: 95.18Micro AUC: 99.47F1 Macro: 13.12F1 Micro: 60.31…
medical-code-prediction-on-mimic-iv-icd9-fullCAML#5Macro AUC: 93.45Micro AUC: 99.29F1 Macro: 11.06F1 Micro: 57.28…
medical-code-prediction-on-mimic-iv-icd9-top50MSMN#1AUC Macro: 95.13AUC Micro: 96.46F1 Macro: 71.85F1 Micro: 75.78…
medical-code-prediction-on-mimic-iv-icd9-top50PLM-ICD#2AUC Macro: 94.97AUC Micro: 96.41F1 Macro: 71.35F1 Micro: 75.46…
medical-code-prediction-on-mimic-iv-icd9-top50Joint LAAT#3AUC Macro: 94.92AUC Micro: 96.31F1 Macro: 69.93F1 Micro: 74.33…
medical-code-prediction-on-mimic-iv-icd9-top50LAAT#4AUC Macro: 94.88AUC Micro: 96.29F1 Macro: 69.99F1 Micro: 74.46…
medical-code-prediction-on-mimic-iv-icd9-top50CAML#5AUC Macro: 93.07AUC Micro: 94.05F1 Macro: 65.33F1 Micro: 69.23…