mT5: A massively multilingual pre-trained text-to-text transformer

Benchmark Model Rank Results
common-sense-reasoning-on-parusMT5 Large#2Accuracy: 0.504
common-sense-reasoning-on-rucosMT5 Large#2Average F1: 0.57EM: 0.562
common-sense-reasoning-on-rwsdMT5 Large#2Accuracy: 0.669
natural-language-inference-on-lidirusMT5 Large#2MCC: 0.061
natural-language-inference-on-rcbMT5 Large#2Average F1: 0.366Accuracy: 0.454
natural-language-inference-on-terraMT5 Large#2Accuracy: 0.561
question-answering-on-danetqaMT5 Large#2Accuracy: 0.657
reading-comprehension-on-musercMT5 Large#1Average F1: 0.844EM: 0.543
zero-shot-cross-lingual-transfer-on-xtrememT5#6Avg: 40.9Sentence-pair Classification: 89.8Structured Prediction: NA