Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models

Benchmark Model Rank Results
instruction-following-on-arena-hard-auto-v2Nanbeige4-3B-Thinking-2511#4Accuracy: 60.0
mathematical-reasoning-on-aime24Nanbeige4-3B-Thinking-2511#10Acc: 90.4
agents-on-bfclv4Nanbeige4-3B-Thinking-2511#11Accuracy: 53.8
code-generation-on-livecodebench-v5Nanbeige4-3B-Base + OpenThoughts3 SFT (extra data)#15Pass@1: 40.9
instruction-following-on-multichallengeNanbeige4-3B-Thinking-2511#15Accuracy: 41.2
multiple-choice-question-answering-mcqa-on-supergpqaNanbeige4-3B-Thinking-2511#15Accuracy: 53.2
mathematical-reasoning-on-math-500Nanbeige4-3B-Base + Ring-Lite SFT (extra data)#22Accuracy: 95.5
mathematical-reasoning-on-aime-2025Nanbeige4-3B-Thinking-2511#32Accuracy: 85.6
multiple-choice-question-answering-mcqa-on-gpqa-diamondNanbeige4-3B-Thinking-2511#50Accuracy: 82.2
code-generation-on-livecodebench-v6Nanbeige4-3B-Base + OpenThoughts3 SFT (extra data)#58Pass@1: 38.8