OpenCodePapers

code-generation-on-conala

Code Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeBLEUExact Match AccuracyModelNameReleaseDate
Fine-Tuning Large Language Models for Answering Programming Questions with Code Snippets44.32PanGu-Coder-FT-I2023-06-26
Leveraging pre-trained language models for code generation✓ Link35.7413.8RoBERTaMarian2024-02-29
MarianCG: a code generation transformer model inspired by machine translation✓ Link34.4310.2MarianCG2022-11-22
The impact of lexical and grammatical processing on generating code from natural language✓ Link34.25.8TranX + BERT w/mined2022-02-28
Code Generation from Natural Language with Less Prior and More Monolingual Data✓ Link33.41BERT + TAE2021-01-01
Leveraging pre-trained language models for code generation✓ Link32.4612.40BERTMarian2024-02-29
Incorporating External Knowledge through Pre-training for Natural Language to Code Generation✓ Link32.26External Knowledge With API + Reranking2020-04-20
Incorporating External Knowledge through Pre-training for Natural Language to Code Generation✓ Link30.69External Knowledge With API2020-04-20
Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation✓ Link30.55BART W/ Mined2021-06-08
Leveraging pre-trained language models for code generation✓ Link30.1810.0ELECTRAMarian2024-02-29
Reranking for Neural Semantic Parsing30.112.8Reranker2019-07-01
Leveraging pre-trained language models for code generation✓ Link29.837.6LUKEMarian2024-02-29
Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation✓ Link26.24BART Base2021-06-08
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation✓ Link24.30TranX2018-10-05
Check out how to contribute new results.