| Paper | Code | F1 | ModelName | ReleaseDate |
|---|---|---|---|---|
| BioMegatron: Larger Biomedical Domain Language Model | ✓ Link | 88.5 | BioMegatron | 2020-10-12 |
| Hero-Gang Neural Model For Named Entity Recognition | ✓ Link | 87.86 | HGN | 2022-05-15 |
| SciFive: a text-to-text transformer model for biomedical literature | ✓ Link | 87.62 | SciFive-Large | 2021-05-28 |
| Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets | ✓ Link | 86.6 | NCBI_BERT(base) (P) | 2019-06-13 |
| LinkBERT: Pretraining Language Models with Document Links | ✓ Link | 86.39 | BioLinkBERT (large) | 2022-03-29 |
| Improving Biomedical Pretrained Language Models with Knowledge | ✓ Link | 86.1 | KeBioLM | 2021-04-21 |
| On the Effectiveness of Compact Biomedical Transformers | ✓ Link | 85.61 | BioDistilBERT | 2022-09-07 |
| On the Effectiveness of Compact Biomedical Transformers | ✓ Link | 85.42 | DistilBioBERT | 2022-09-07 |
| On the Effectiveness of Compact Biomedical Transformers | ✓ Link | 85.38 | CompactBioBERT | 2022-09-07 |
| On the Effectiveness of Compact Biomedical Transformers | ✓ Link | 84.62 | BioMobileBERT | 2022-09-07 |