| question-answering-on-natural-questions | Switch Distillation (1B; 7B teacher, q30% mid-training) | #51 | EM: 25.3 |
| multi-task-language-understanding-on-mmlu-pro | Switch Distillation (1B; 7B teacher, after DPO) | #132 | Accuracy: 20.1 |
| common-sense-reasoning-on-winogrande | Switch Distillation (1B; 7B teacher, after SFT) | #142 | Accuracy: 56.1 |
| math-word-problem-solving-on-math | Switch Distillation (1B; 7B teacher, full post-training) | #155 | Accuracy: 22.4 |
| arithmetic-reasoning-on-gsm8k | Switch Distillation (1B; 7B teacher, full post-training) | #157 | Accuracy: 79.8 |