HyperCLOVA X THINK Technical Report

Benchmark Model Rank Results
instruction-following-on-mtbenchHyperCLOVA X SEED 14B Think#6Score (1-10): 8.8313
code-generation-on-mbppHyperCLOVA X SEED 14B Think#15Accuracy: 87.59
arithmetic-reasoning-on-gsm8kHyperCLOVA X SEED 14B Think#17Accuracy: 95.53
code-generation-on-humanevalHyperCLOVA X SEED 14B Think#19Pass@1: 94.5
mathematical-reasoning-on-math-500HyperCLOVA X SEED 14B Think#39Accuracy: 93.8