OpenCodePapers

code-generation-on-django

Code Generation

Results over time

Click legend items to toggle metrics. Hover points for model names.

Leaderboard

Paper	Code	Accuracy	BLEU Score	ModelName	ReleaseDate
MarianCG: a code generation transformer model inspired by machine translation	✓ Link	81.83	90.41	MarianCG	2022-11-22
The impact of lexical and grammatical processing on generating code from natural language	✓ Link	81.03	79.86	TranX + BERT w/mined	2022-02-28
Code Generation from Natural Language with Less Prior and More Monolingual Data	✓ Link	81.03		BERT + TAE	2021-01-01
Reranking for Neural Semantic Parsing		80.2		Reranker	2019-07-01
Leveraging pre-trained language models for code generation	✓ Link	78.50	89.34	LUKEMarian	2024-02-29
Leveraging pre-trained language models for code generation	✓ Link	77.95	88.91	RoBERTaMarian	2024-02-29
Leveraging pre-trained language models for code generation	✓ Link	76.68	56.55	BERTMarian	2024-02-29
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation	✓ Link	73.7		Tranx	2018-10-05
Leveraging pre-trained language models for code generation	✓ Link	65.32	53.02	ELECTRAMarian	2024-02-29
Latent Predictor Networks for Code Generation	✓ Link	62.3	77.6	lpn (Ling et al., 2016)	2016-03-22
Latent Predictor Networks for Code Generation	✓ Link	31.5	47.6	Phrasal Statistical MT (Ling et al., 2016)	2016-03-22