AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model

Benchmark Model Rank Results
common-sense-reasoning-on-recordAlexaTM 20B#19F1: 88.4
coreference-resolution-on-winograd-schemaAlexaTM 20B#33Accuracy: 68.3
natural-language-inference-on-commitmentbankAlexaTM 20B#13Accuracy: 67.9
natural-language-inference-on-rteAlexaTM 20B#53Accuracy: 68.6%
question-answering-on-boolqAlexaTM 20B#41Accuracy: 69.4
question-answering-on-copaAlexaTM 20B#36Accuracy: 78.0
question-answering-on-multircAlexaTM 20B#19F1: 59.6
word-sense-disambiguation-on-words-in-contextAlexaTM 20B#14Accuracy: 53.3