NVIDIA Nemotron 3.5 Lightning

Benchmark Model Rank Results
agents-on-pinchbenchNVIDIA Nemotron 3.5 Lightning 30B-A3B#3Accuracy: 85.37
code-generation-on-scicodeNVIDIA Nemotron 3.5 Lightning 30B-A3B#21Accuracy: 32.6
multi-task-language-understanding-on-mmlu-proNVIDIA Nemotron 3.5 Lightning 30B-A3B#33Accuracy: 81.94
question-answering-on-humanity-s-last-exam-hleNVIDIA Nemotron 3.5 Lightning 30B-A3B#37Accuracy: 11.72
code-generation-on-swe-bench-multilingualNVIDIA Nemotron 3.5 Lightning 30B-A3B (NeMo Evaluator)#38Accuracy: 39.33
code-generation-on-terminal-bench-2-1NVIDIA Nemotron 3.5 Lightning 30B-A3B (Mini-SWE-agent v2.4.5)#45Accuracy: 29.7
deep-research-agents-on-browsecompNVIDIA Nemotron 3.5 Lightning 30B-A3B#49Accuracy: 36.97
code-generation-on-swe-bench-verifiedNVIDIA Nemotron 3.5 Lightning 30B-A3B (OpenCode v1.17.8)#66Accuracy: 60.0
multiple-choice-question-answering-mcqa-on-gpqa-diamondNVIDIA Nemotron 3.5 Lightning 30B-A3B#69Accuracy: 75.44