Paragraph-based Transformer Pre-training for Multi-Sentence Inference

Benchmark Model Rank Results
answer-selection-on-asnqRoBERTa-Base Joint MSPP#1MAP: 0.673MRR: 0.737
fact-verification-on-feverRoBERTa-Base Joint MSPP Flexible#2Accuracy: 75.36
fact-verification-on-feverRoBERTa-Base Joint MSPP#3Accuracy: 74.39
question-answering-on-trecqaRoBERTa-Base Joint + MSPP#3MAP: 0.911MRR: 0.952
question-answering-on-wikiqaRoBERTa-Base Joint MSPP#3MAP: 0.887MRR: 0.900