daVinci-Env: Open SWE Environment Synthesis at Scale

Benchmark Model Rank Results
code-generation-on-swe-bench-verifiedOpenSWE-72B (SWE-Agent)#54Accuracy: 66.0
code-generation-on-swe-bench-verifiedOpenSWE-32B (SWE-Agent)#58Accuracy: 62.4
multi-task-language-understanding-on-mmlu-proOpenSWE-72B (Qwen2.5-72B-Base)#64Accuracy: 72.7
code-generation-on-humanevalOpenSWE-72B (Qwen2.5-72B-Base)#72Pass@1: 76.25
arithmetic-reasoning-on-gsm8kOpenSWE-72B (Qwen2.5-72B-Base)#79Accuracy: 89.16
mathematical-reasoning-on-math-500OpenSWE-72B (Qwen2.5-72B-Base)#110Accuracy: 72.6