| Paper | Code | Accuracy | ModelName | ReleaseDate |
|---|---|---|---|---|
| Motif 3: Technical Report | ✓ Link | 94.71 | Motif 3 Base (25-shot) | 2026-08-10 |
| Nemotron-4 340B Technical Report | ✓ Link | 94.28 | Nemotron-4-340B-Base (25-shot) | 2024-06-17 |
| Gemma 2: Improving Open Language Models at a Practical Size | ✓ Link | 71.4 | Gemma 2 27B (25-shot) | 2024-07-31 |
| Qwen2 Technical Report | ✓ Link | 68.9 | Qwen2-72B | 2024-07-15 |
| The Zamba2 Suite: Technical Report | ✓ Link | 68.9 | Zamba2-7B (25-shot) | 2024-11-22 |
| Encoder-Decoder Gemma: Improving the Quality-Efficiency Trade-Off via Adaptation | ✓ Link | 65.0 | T5Gemma 9B-9B PrefixLM | 2025-04-08 |
| Jamba: A Hybrid Transformer-Mamba Language Model | ✓ Link | 64.4 | Jamba (25-shot) | 2024-03-28 |
| Qwen2 Technical Report | ✓ Link | 64.1 | Qwen2-57B-A14B | 2024-07-15 |
| Gemma: Open Models Based on Gemini Research and Technology | ✓ Link | 53.2 | Gemma 7B (25-shot) | 2024-03-13 |