Rethinking embedding coupling in pre-trained language models

Benchmark Model Rank Results
cross-lingual-natural-language-inference-on-xnliDecoupled#2Accuracy: 71.3
cross-lingual-natural-language-inference-on-xnliCoupled#3Accuracy: 70.7
cross-lingual-question-answering-on-tydiqa-goldpDecoupled#6EM: 42.8F1: 58.1
cross-lingual-question-answering-on-xquadDecoupled#2EM: 46.9F1: 63.8
cross-lingual-question-answering-on-xquadCoupled#3EM: 46.2F1: 63.2