| Paper | Code | F1 | ModelName | ReleaseDate |
|---|---|---|---|---|
| VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understanding | 76.01 | VarMAE | 2022-11-01 | |
| Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing | ✓ Link | 73.38 | PubMedBERT uncased | 2020-07-31 |
| SciBERT: A Pretrained Language Model for Scientific Text | ✓ Link | 71.18 | SciBERT (SciVocab) | 2019-03-26 |
| SciBERT: A Pretrained Language Model for Scientific Text | ✓ Link | 70.82 | SciBERT (Base Vocab) | 2019-03-26 |
| A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literature | ✓ Link | 66.30 | bi-LSTM | 2018-06-11 |