| Paper | Code | pairwise accuracy | Accuracy (%) | ModelName | ReleaseDate |
|---|---|---|---|---|---|
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 72.4 | 62.0 | ViLBERT 12-in-1 | 2021-12-14 |
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 64.4 | 55.1 | LXMERT | 2021-12-14 |
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 61.2 | 50.3 | ViLBERT | 2021-12-14 |
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 56.2 | CLIP | 2021-12-14 | |
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 53.1 | GPT1 | 2021-12-14 | |
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 51.9 | GPT2 | 2021-12-14 | |
| VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | ✓ Link | 45.7 | 46.5 | VisualBERT | 2021-12-14 |