On the Effectiveness of Compact Biomedical Transformers

Benchmark Model Rank Results
named-entity-recognition-ner-on-jnlpbaBioMobileBERT#5F1: 80.13
named-entity-recognition-ner-on-jnlpbaDistilBioBERT#7F1: 79.97
named-entity-recognition-ner-on-jnlpbaCompactBioBERT#8F1: 79.88
named-entity-recognition-ner-on-jnlpbaBioDistilBERT#10F1: 79.1
named-entity-recognition-ner-on-ncbi-diseaseCompactBioBERT#10F1: 88.67
named-entity-recognition-ner-on-ncbi-diseaseDistilBioBERT#14F1: 87.93
named-entity-recognition-ner-on-ncbi-diseaseBioDistilBERT#18F1: 87.61
named-entity-recognition-ner-on-ncbi-diseaseBioMobileBERT#20F1: 87.21
named-entity-recognition-on-bc2gmBioDistilBERT#2F1: 86.97
named-entity-recognition-on-bc2gmCompactBioBERT#3F1: 86.71
named-entity-recognition-on-bc2gmDistilBioBERT#4F1: 86.6
named-entity-recognition-on-bc2gmBioMobileBERT#7F1: 85.26
named-entity-recognition-on-bc5cdr-chemicalDistilBioBERT#4F1: 94.53
named-entity-recognition-on-bc5cdr-chemicalBioDistilBERT#5F1: 94.48
named-entity-recognition-on-bc5cdr-chemicalCompactBioBERT#6F1: 94.31
named-entity-recognition-on-bc5cdr-chemicalBioMobileBERT#7F1: 94.23
named-entity-recognition-on-bc5cdr-diseaseBioDistilBERT#7F1: 85.61
named-entity-recognition-on-bc5cdr-diseaseDistilBioBERT#8F1: 85.42
named-entity-recognition-on-bc5cdr-diseaseCompactBioBERT#9F1: 85.38
named-entity-recognition-on-bc5cdr-diseaseBioMobileBERT#10F1: 84.62