| crass-ai-on-big-bench | Chinchilla-70B (few-shot, k=5) | #1 | Accuracy: 75.0 |
| logical-reasoning-on-big-bench-logic-grid-puzzle | Chinchilla-70B (few-shot, k=5) | #1 | Accuracy: 44 |
| word-sense-disambiguation-on-big-bench-anachronisms | Chinchilla-70B (few-shot, k=5) | #1 | Accuracy: 69.1 |
| common-sense-reasoning-on-big-bench-known-unknowns | Chinchilla-70B (few-shot, k=5) | #2 | Accuracy: 65.2 |
| common-sense-reasoning-on-big-bench-winowhy | Chinchilla-70B (few-shot, k=5) | #2 | Accuracy: 62.5 |
| logical-reasoning-on-big-bench-strategyqa | Chinchilla-70B (few-shot, k=5) | #2 | Accuracy: 68.3 |
| multiple-choice-question-answering-mcqa-on-big-bench-novel-concepts | Chinchilla-70B (few-shot, k=5) | #2 | Accuracy: 65.6 |
| logical-reasoning-on-big-bench-penguins-in-a-table | Chinchilla-70B (few-shot, k=5) | #3 | Accuracy: 48.7 |
| logical-reasoning-on-big-bench-reasoning-about-colored-objects | Chinchilla-70B (few-shot, k=5) | #3 | Accuracy: 59.7 |
| common-sense-reasoning-on-big-bench-causal-judgment | Chinchilla-70B (few-shot, k=5) | #4 | Accuracy: 57.4 |
| common-sense-reasoning-on-big-bench-disambiguation-qa | Chinchilla-70B (few-shot, k=5) | #4 | Accuracy: 54.7 |
| common-sense-reasoning-on-big-bench-sports-understanding | Chinchilla-70B (few-shot, k=5) | #4 | Accuracy: 71 |
| multiple-choice-question-answering-mcqa-on-big-bench-navigate | Chinchilla-70B (few-shot, k=5) | #4 | Accuracy: 52.6 |
| common-sense-reasoning-on-big-bench-date-understanding | Chinchilla-70B (few-shot, k=5) | #5 | Accuracy: 52.3 |
| logical-reasoning-on-big-bench-temporal-sequences | Chinchilla-70B (few-shot, k=5) | #5 | Accuracy: 32.0 |
| logical-reasoning-on-big-bench-formal-fallacies-syllogisms-negation | Chinchilla-70B (few-shot, k=5) | #7 | Accuracy: 52.1 |
| sarcasm-detection-on-big-bench-snarks | Chinchilla-70B (few-shot, k=5) | #7 | Accuracy: 58.6 |
| multiple-choice-question-answering-mcqa-on-big-bench-hyperbaton | Chinchilla-70B (few-shot, k=5) | #8 | Accuracy: 54.2 |
| multiple-choice-question-answering-mcqa-on-big-bench-movie-recommendation | Chinchilla-70B (few-shot, k=5) | #8 | Accuracy: 75.6 |
| multiple-choice-question-answering-mcqa-on-big-bench-ruin-names | Chinchilla-70B (few-shot, k=5) | #8 | Accuracy: 47.1 |
| language-modelling-on-lambada | Chinchilla (Zero-Shot) | #12 | Accuracy: 77.7 |
| question-answering-on-social-iqa | Chinchilla (zero-shot) | #19 | Accuracy: 51.3 |
| question-answering-on-boolq | Chinchilla 70B (0-shot) | #31 | Accuracy: 83.7 |
| multi-task-language-understanding-on-mmlu | chatgpt/gpt3.5(20B) | #33 | Average (%): 67.5 |
| question-answering-on-natural-questions | Chinchilla (few-shot, k=64) | #36 | EM: 35.5 |
| question-answering-on-piqa | Chinchilla 70B (0-shot) | #42 | Accuracy: 81.8 |
| common-sense-reasoning-on-winogrande | Chinchilla 70B (0-shot) | #56 | Accuracy: 74.9 |
| sentence-completion-on-hellaswag | Chinchilla 70B (0-shot) | #68 | Accuracy: 80.8 |