OpenCodePapers

code-generation-on-pecc

Code Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodePass@3ModelNameReleaseDate
PECC: Problem Extraction and Coding Challenges✓ Link27.67Claude 3 Haiku2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link23.75GPT-3.5 Turbo2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link11.39codechat-bison2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link8.48chat-bison2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link8.35Mixtral-8x7B-Instruct2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link7.18Phi-3-mini-128k-instruct2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link3.72WizardLM-2-7B2024-04-29
PECC: Problem Extraction and Coding Challenges✓ Link3.1Llama-3-8B-Instruct2024-04-29
Check out how to contribute new results.