ReasonBERT: Pre-trained to Reason with Distant Supervision

Benchmark Model Rank Results
question-answering-on-triviaqaReasonBERTR#43F1: 45.5
question-answering-on-triviaqaReasonBERTB#44F1: 37.2