CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules

Benchmark Model Rank Results
code-generation-on-appsCodeChain+WizardCoder-15b#7Introductory Pass@1: 29.3%Interview Pass@1: 6.4%
code-generation-on-appsWizardCoder-15b#8Introductory Pass@1: 26.29Interview Pass@1: 7.49
code-generation-on-codecontestsCodeChain + WizardCoder-15B#7Test Set pass@1: 2.35Test Set pass@5: 3.29Val Set pass@1: 2.48