XLM-E: Cross-lingual Language Model Pre-training via ELECTRA

Benchmark Model Rank Results
zero-shot-cross-lingual-transfer-on-xtremeTuring ULR v6#1Avg: 85.5Sentence-pair Classification: 91.0
zero-shot-cross-lingual-transfer-on-xtremeTuring ULR v5#2Avg: 84.5Sentence-pair Classification: 90.3