ReasonBERT: Pre-trained to Reason with Distant Supervision

Benchmark Model Rank Results
question-answering-on-triviaqaReasonBERTR#35F1: 45.5
question-answering-on-triviaqaReasonBERTB#36F1: 37.2