UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training

Benchmark Model Rank Results
abstractive-text-summarization-on-cnn-dailyUniLMv2#23ROUGE-1: 43.16ROUGE-2: 20.42ROUGE-L: 40.14
question-generation-on-squad11UniLMv2#3BLEU-4: 24.43