RuCoLA: Russian Corpus of Linguistic Acceptability

Benchmark Model Rank Results
linguistic-acceptability-on-colaRemBERT#35MCC: 0.6
linguistic-acceptability-on-itacolaXLM-R#2MCC: 0.52
linguistic-acceptability-on-itacolamBERT#4MCC: 0.36
linguistic-acceptability-on-rucolaruRoBERTa#2MCC: 0.53Accuracy: 79.34
linguistic-acceptability-on-rucolaRemBERT#4MCC: 0.44Accuracy: 75.06
linguistic-acceptability-on-rucolaruBERT#5MCC: 0.42Accuracy: 74.3
linguistic-acceptability-on-rucolaruGPT-3#6MCC: 0.30Accuracy: 53.82
linguistic-acceptability-on-rucolaruT5#7MCC: 0.25Accuracy: 68.41
linguistic-acceptability-on-rucolamBERT#8MCC: 0.15
linguistic-acceptability-on-rucolaXLM-R#9MCC: 0.13Accuracy: 61.13