| Benchmark | Model | Rank | Results |
|---|---|---|---|
| text-to-sql-on-spider-1 | T5-3B+PICARD | #1 | Exact Match Accuracy (in Dev): 75.5Execution Accuracy (in Dev): 79.3 |
| text-to-sql-on-spider-1 | T5-3B | #4 | Exact Match Accuracy (in Dev): 71.5Execution Accuracy (in Dev): 74.4 |
| dialogue-state-tracking-on-cosql | T5-3B + PICARD | #2 | question match accuracy: 54.6interaction match accuracy: 23.7 |
| semantic-parsing-on-spider | T5-3B + PICARD | #5 | Accuracy: 71.9 |
| text-to-sql-on-spider | T5-3B + PICARD | #11 | Execution Accuracy (Test): 75.1Exact Match Accuracy (Test): 71.9… |