StarCoder: may the source be with you!

Open paper
Benchmark Model Rank Results
code-generation-on-mbppStarCoder 15.5B#45Accuracy: 52.7
code-generation-on-mbppStarCoderBase 15.5B#52Accuracy: 49
code-generation-on-mbppSantaCoder 1.1B#76Accuracy: 35

Rank counts only results with a code link.