AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model

Benchmark Model Rank Results
natural-language-inference-on-commitmentbankAlexaTM 20B#13Accuracy: 67.9
word-sense-disambiguation-on-words-in-contextAlexaTM 20B#14Accuracy: 53.3
common-sense-reasoning-on-recordAlexaTM 20B#19F1: 88.4
question-answering-on-multircAlexaTM 20B#19F1: 59.6
coreference-resolution-on-winograd-schema-challengeAlexaTM 20B#33Accuracy: 68.3
question-answering-on-copaAlexaTM 20B#36Accuracy: 78.0
natural-language-inference-on-rteAlexaTM 20B#57Accuracy: 68.6%
question-answering-on-boolqAlexaTM 20B#69Accuracy: 69.4