Introducing Beam: Reflection's 501B open-weight model

Benchmark Model Rank Results
agents-on-automationbench-publicBeam–Success Rate: 37.0
code-generation-on-deepsweBeam–Pass@1: 0.444
code-generation-on-scicodeBeam–Accuracy: 49.7
code-generation-on-swe-bench-multilingualBeam–Accuracy: 78.0
code-generation-on-swe-bench-proBeam–Resolved: 65.5
code-generation-on-swe-bench-verifiedBeam–Accuracy: 80.9
code-generation-on-terminal-bench-2-1Beam–Accuracy: 80.1
deep-research-agents-on-browsecompBeam (w/ context management)–Accuracy: 77.4
instruction-following-on-ifbenchBeam–Accuracy: 79.7
long-context-understanding-on-longbench-v2Beam–Accuracy: 65.5
mathematical-reasoning-on-aime-2026Beam–Accuracy: 97.8
multiple-choice-question-answering-mcqa-on-gpqa-diamondBeam–Accuracy: 90.5
physics-question-answering-on-critptBeam–Accuracy: 16.3
question-answering-on-humanity-s-last-exam-hleBeam–Accuracy: 36.2