Paper | Code | Correctness, avg., % | Correctness, max., % | Validness, avg., % | Validness, max., % | ModelName | ReleaseDate |
---|---|---|---|---|---|---|---|
Optimizing Large Language Models for OpenAPI Code Completion | ✓ Link | 34 | 42 | 69.1 | 76 | Code Llama 7B, fine-tuned with document splitting | 2024-05-24 |
Optimizing Large Language Models for OpenAPI Code Completion | ✓ Link | 32 | 45 | 63.1 | 84 | Code Llama 7B, fine-tuned at 4096 tokens | 2024-05-24 |
Optimizing Large Language Models for OpenAPI Code Completion | ✓ Link | 31.1 | 36 | 60.7 | 64 | Code Llama 7B | 2024-05-24 |
Optimizing Large Language Models for OpenAPI Code Completion | ✓ Link | 29 | 29 | 68 | 68 | GitHub Copilot | 2024-05-24 |