| Benchmark | Model | Rank | Results |
|---|---|---|---|
| dialogue-state-tracking-on-cosql | RASAT+PICARD | #1 | question match accuracy: 55.7interaction match accuracy: 26.5 |
| text-to-sql-on-sparc | RASAT+PICARD | #1 | interaction match accuracy: 45.2question match accuracy: 67.7 |
| text-to-sql-on-spider-1 | RASAT+PICARD | #2 | Exact Match Accuracy (in Dev): 75.3Execution Accuracy (in Dev): 80.5 |
| text-to-sql-on-spider-1 | RASAT | #3 | Exact Match Accuracy (in Dev): 72.6Execution Accuracy (in Dev): 76.6 |
| semantic-parsing-on-spider | RASAT+PICARD | #3 | Accuracy: 75.5 |