OpenCodePapers

vulnerability-reproduction-on-cybergym

CybersecurityVulnerability Reproduction
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeSuccess RateModelNameReleaseDate
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression✓ Link88.1DeepSeek-V4.1-Flash Max (DeepSeek Harness (Minimal))2026-09-17
Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs✓ Link87.9Ling-3.1-flash2025-03-07
Atria Dawn: The Dawn of Agentic Superintelligence✓ Link86.5Atria Dawn Preview (Claude Code v2.1.119)2026-09-14
GLM-5.3: Frontier Coding with Emergent Cyber Capabilities✓ Link84.5GLM-5.3 (Claude Code)2026-08-14
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link83.3DeepSeek-V4-Pro-0813 (Max)2026-04-26
Hy4 preview✓ Link78.4Hy4 preview2026-08-28
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link76.7DeepSeek-V4-Flash-0731 (Max)2026-04-26
On the Limitations of Non-GPU AI Accelerators for Large-Model Inference: A Field Study of MoE and Multimodal Serving on Huawei Ascend75.3DeepSeek-V4-Flash-Vision-Exp (DeepSeek Harness)2026-07-09
Feyospace-v1: How the Cyber Mercury Seven Trained Frontier Cyber Models63.24Feyospace-s1 (Claude Code 2.1.210)2026-09-08
CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild✓ Link58.1OpenAegis2026-08-24
Muse Spark Safety & Preparedness Report43.5Muse Spark Open (Minimal ReAct agent in a CentOS CyberGym environment; one submission attempt per challenge)2026-05-14