Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification

Benchmark Model Rank Results
medical-code-prediction-on-mimic-iv-icd-10-1MSMN#1Macro-AUC: 97.07Micro-AUC: 99.61Macro-F1: 5.42Micro-F1: 55.91
medical-code-prediction-on-mimic-iv-icd-10-1Joint LAAT#2Macro-AUC: 93.64Micro-AUC: 99.27Macro-F1: 5.71Micro-F1: 55.89
medical-code-prediction-on-mimic-iv-icd-10-1LAAT#3Macro-AUC: 92.96Micro-AUC: 99.14Macro-F1: 4.47Micro-F1: 55.40
medical-code-prediction-on-mimic-iv-icd-10-1PLM#4Macro-AUC: 91.85Micro-AUC: 99.02Macro-F1: 4.90Micro-F1: 56.95
medical-code-prediction-on-mimic-iv-icd-10-1CAML#5Macro-AUC: 89.91Micro-AUC: 98.79Macro-F1: 4.07Micro-F1: 52.67
medical-code-prediction-on-mimic-iv-icd10MSMN#1F1 (micro): 74.15F1 (macro): 69.01AUC (Micro): 95.61
medical-code-prediction-on-mimic-iv-icd10PLM-ICD#2F1 (micro): 73.27F1 (macro): 70.31AUC (Micro): 95.69
medical-code-prediction-on-mimic-iv-icd10Joint LAAT#3F1 (micro): 72.85F1 (macro): 68.41AUC (Micro): 95.57
medical-code-prediction-on-mimic-iv-icd10LAAT#4F1 (micro): 72.56F1 (macro): 68.15AUC (Micro): 95.49
medical-code-prediction-on-mimic-iv-icd10CAML#5F1 (micro): 67.56F1 (macro): 64.30AUC (Micro): 93.18
medical-code-prediction-on-mimic-iv-icd9MSMN#1AUC Macro: 95.13AUC Micro: 96.46F1 Macro: 71.85F1 Micro: 75.78
medical-code-prediction-on-mimic-iv-icd9PLM-ICD#2AUC Macro: 94.97AUC Micro: 96.41F1 Macro: 71.35F1 Micro: 75.46
medical-code-prediction-on-mimic-iv-icd9Joint LAAT#3AUC Macro: 94.92AUC Micro: 96.31F1 Macro: 69.93F1 Micro: 74.33
medical-code-prediction-on-mimic-iv-icd9LAAT#4AUC Macro: 94.88AUC Micro: 96.29F1 Macro: 69.99F1 Micro: 74.46
medical-code-prediction-on-mimic-iv-icd9CAML#5AUC Macro: 93.07AUC Micro: 94.05F1 Macro: 65.33F1 Micro: 69.23
medical-code-prediction-on-mimic-iv-icd9-fullMSMN#1Macro AUC: 96.79Micro AUC: 99.56F1 Macro: 13.94F1 Micro: 61.15
medical-code-prediction-on-mimic-iv-icd9-fullPLM-ICD#2Macro AUC: 96.61Micro AUC: 99.53F1 Macro: 14.40F1 Micro: 62.45
medical-code-prediction-on-mimic-iv-icd9-fullJoint LAAT#3Macro AUC: 95.57Micro AUC: 99.49F1 Macro: 14.17F1 Micro: 60.37
medical-code-prediction-on-mimic-iv-icd9-fullLAAT#4Macro AUC: 95.18Micro AUC: 99.47F1 Macro: 13.12F1 Micro: 60.31
medical-code-prediction-on-mimic-iv-icd9-fullCAML#5Macro AUC: 93.45Micro AUC: 99.29F1 Macro: 11.06F1 Micro: 57.28