| Benchmark | Model | Rank | Results |
|---|---|---|---|
| code-generation-on-conala | TranX | #12 | BLEU: 24.30 |
| code-generation-on-conala-ext | TranX | #5 | BLEU: 18.85 |
| code-generation-on-django | Tranx | #7 | Accuracy: 73.7 |
| code-generation-on-wikisql | Tranx | #3 | Execution Accuracy: 78.6Exact Match Accuracy: 68.6 |
| semantic-parsing-on-atis | Tranx | #2 | Accuracy: 86.2 |
| semantic-parsing-on-geo | Tranx | #3 | Accuracy: 87.7 |