On the importance of pre-training data volume for compact language models
Open paper
Benchmark
Model
Rank
Results
question-answering-on-fquad
LePetit
–
EM: 57.2
F1: 70.71
Rank counts only results with a code link.