Reranking for Neural Semantic Parsing
Open paper
Benchmark
Model
Rank
Results
code-generation-on-conala
Reranker
–
BLEU: 30.11
Exact Match Accuracy: 2.8
code-generation-on-conala-ext
Reranker
–
BLEU: 19.85
code-generation-on-django
Reranker
–
Accuracy: 80.2
Rank counts only results with a code link.