Hybrid Policy Distillation for LLMs
Open paper
Benchmark
Model
Rank
Results
code-generation-on-mbpp
HPD (Qwen2.5-Coder, 1.5B)
#44
Accuracy: 75.4
code-generation-on-humaneval
HPD (Qwen2.5-Coder, 1.5B)
#63
Pass@1: 79.3
Rank counts only results with a code link.