CoWindow Attention: Full Causal Coverage Is a Collective Property

Benchmark Model Rank Results
common-sense-reasoning-on-winograndeCoWA (32B)–Accuracy: 81.72
multi-task-language-understanding-on-mmlu-proCoWA (32B)–Accuracy: 68.51
question-answering-on-piqaCoWA (32B)–Accuracy: 85.75
sentence-completion-on-hellaswagCoWA (32B)–Accuracy: 83.1