SantaCoder: don't reach for the stars!

Open paper
Benchmark Model Rank Results
code-generation-on-humanevalSantaCoder#137Pass@1: 18
code-generation-on-mbppSantaCoder#144Accuracy: 35

Rank counts only results with a code link.