| code-completion-on-safim | deepseek-coder-33b-base | #1 | Average: 69.01Algorithmic: 60.78Control: 71.10API: 75.16 |
| code-completion-on-safim | deepseek-coder-6.7b-base | #2 | Average: 63.40Algorithmic: 54.74Control: 65.79API: 69.68 |
| code-completion-on-safim | starcoderbase | #3 | Average: 55.54Algorithmic: 44.11Control: 54.46API: 68.06 |
| code-completion-on-safim | gpt-4-1106-preview | #4 | Average: 53.28Algorithmic: 42.11Control: 55.15API: 62.58 |
| code-completion-on-safim | CodeLlama-13b-hf | #5 | Average: 52.78Algorithmic: 41.41Control: 57.25API: 59.68 |
| code-completion-on-safim | deepseek-coder-1.3b-base | #6 | Average: 52.63Algorithmic: 41.20Control: 54.10API: 62.58 |
| code-completion-on-safim | CodeLlama-34b-hf | #7 | Average: 49.66Algorithmic: 38.55Control: 53.98API: 56.45 |
| code-completion-on-safim | CodeLlama-7b-hf | #8 | Average: 45.00Algorithmic: 34.68Control: 53.56API: 46.77 |
| code-completion-on-safim | gpt-3.5-turbo-0301 | #9 | Average: 40.86Algorithmic: 31.24Control: 37.48API: 53.87 |
| code-completion-on-safim | incoder-6B | #10 | Average: 33.79Algorithmic: 25.16Control: 28.16API: 48.06 |
| code-completion-on-safim | codegen-16B-multi | #11 | Average: 30.99Algorithmic: 25.94Control: 35.74API: 31.29 |
| code-completion-on-safim | codegen-2B-multi | #12 | Average: 29.55Algorithmic: 23.49Control: 32.89API: 32.26 |
| code-completion-on-safim | incoder-1B | #13 | Average: 29.27Algorithmic: 21.06Control: 22.89API: 43.87 |
| code-completion-on-safim | codegen-6B-multi | #14 | Average: 28.71Algorithmic: 23.60Control: 34.80API: 27.74 |
| code-completion-on-safim | codegen-350M-multi | #15 | Average: 22.94Algorithmic: 16.30Control: 26.06API: 26.45 |