Lifting the Curse of Multilinguality by Pre-training Modular Transformers

Open paper

Benchmark	Model	Rank	Results
cross-lingual-question-answering-on-xquad	X-MOD Base (60-lang)	#6	Average F1: 72.8