Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation

Open paper
Benchmark Model Rank Results
code-generation-on-conala-extBART W/ Mined#1BLEU: 35.32
code-generation-on-conala-extBART Base#2BLEU: 34.35
code-generation-on-conalaBART W/ Mined#8BLEU: 30.55
code-generation-on-conalaBART Base#11BLEU: 26.24

Rank counts only results with a code link.