PretrainZero: Reinforcement Active Pretraining

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kPretrainZero (Qwen3-30B-A3B-MoE-Base)–Accuracy: 94.4
mathematical-reasoning-on-aime24PretrainZero (Qwen3-8B-Base)–Acc: 20.0
mathematical-reasoning-on-math-500PretrainZero (Qwen3-8B-Base)–Accuracy: 81.9
mathematical-reasoning-on-minerva-mathPretrainZero (Qwen3-30B-A3B-MoE-Base)–Accuracy: 41.2
multi-task-language-understanding-on-mmlu-proPretrainZero (Qwen3-30B-A3B-MoE-Base)–Accuracy: 64.59