Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Benchmark Model Rank Results
common-sense-reasoning-on-commonsenseqaDeBERTaV3-large+KEAR#2Accuracy: 91.2
common-sense-reasoning-on-commonsenseqaKEAR#4Accuracy: 89.4
common-sense-reasoning-on-commonsenseqaGPT-3 Direct Finetuned#15Accuracy: 73.0