| citation-intent-classification-on-scicite | SciBERT | #4 | Macro-F1: 86.32 |
| named-entity-recognition-ner-on-bc5cdr | SciBERT (SciVocab) | #10 | F1: 88.94 |
| named-entity-recognition-ner-on-bc5cdr | SciBERT (Base Vocab) | #12 | F1: 88.11 |
| named-entity-recognition-ner-on-jnlpba | SciBERT (Base Vocab) | #16 | F1: 75.77 |
| named-entity-recognition-ner-on-ncbi-disease | SciBERT (Base Vocab) | #21 | F1: 86.88 |
| named-entity-recognition-ner-on-ncbi-disease | SciBERT (SciVocab) | #23 | F1: 86.45 |
| named-entity-recognition-ner-on-scierc | SciBERT (SciVocab) | #5 | F1: 67.57 |
| named-entity-recognition-ner-on-scierc | SciBERT (Base Vocab) | #6 | F1: 65.24 |
| participant-intervention-comparison-outcome | SciBERT (SciVocab) | #2 | F1: 71.18 |
| participant-intervention-comparison-outcome | SciBERT (Base Vocab) | #3 | F1: 70.82 |
| relation-extraction-on-chemprot | SciBert (Finetune) | #1 | F1: 83.64 |
| relation-extraction-on-chemprot | SciBERT (Base Vocab) | #10 | F1: 73.7 |