Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study

Benchmark Model Rank Results
medical-code-prediction-on-mimic-iv-icd-10PLM-ICD#1Precision@8: 69.9F1 Macro: 21.1F1 Micro: 58.5Precision@15: 55.0
medical-code-prediction-on-mimic-iv-icd-10LAAT#2Precision@8: 68.9F1 Macro: 20.3F1 Micro: 57.9Precision@15: 54.3
medical-code-prediction-on-mimic-iv-icd-10MultiResCNN#3Precision@8: 67.8F1 Macro: 21.1F1 Micro: 56.9Precision@15: 53.5
medical-code-prediction-on-mimic-iv-icd-10CAML#4Precision@8: 66.8F1 Macro: 16.0F1 Micro: 55.4Precision@15: 52.2
medical-code-prediction-on-mimic-iv-icd-10Bi-GRU#5Precision@8: 62.6F1 Macro: 10.6F1 Micro: 50.1Precision@15: 47.7
medical-code-prediction-on-mimic-iv-icd-10CNN#6Precision@8: 60.3F1 Macro: 8.0F1 Micro: 47.2Precision@15: 45.7
medical-code-prediction-on-mimic-iv-icd-9PLM-ICD#1AUC Macro: 97.2AUC Micro: 99.4Exact Match Ratio: 1.0F1 Macro: 29.8
medical-code-prediction-on-mimic-iv-icd-9LAAT#2AUC Macro: 96.0AUC Micro: 99.3Exact Match Ratio: 0.9F1 Macro: 26.4
medical-code-prediction-on-mimic-iv-icd-9MultiResCNN#3AUC Macro: 95.1AUC Micro: 99.2Exact Match Ratio: 0.8F1 Macro: 27.7
medical-code-prediction-on-mimic-iv-icd-9Bi-GRU#4AUC Macro: 93.8AUC Micro: 98.8Exact Match Ratio: 0.7F1 Macro: 16.6
medical-code-prediction-on-mimic-iv-icd-9CAML#5AUC Macro: 90.7AUC Micro: 98.8Exact Match Ratio: 0.6F1 Macro: 19.3
medical-code-prediction-on-mimic-iv-icd-9CNN#6AUC Macro: 89.4AUC Micro: 98.1Exact Match Ratio: 0.6F1 Macro: 12.6