Paper | Code | Accuracy | ModelName | ReleaseDate |
---|---|---|---|---|
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 24.0 | GPT-4V | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 13.2 | Gemini Pro | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 1.8 | LLaVa-1.5-13B | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 1.5 | LLaVa-1.5-7B | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 0.9 | BLIP2-FLAN-T5-XXL | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 0.9 | CogVLM | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 0.9 | QWEN | 2024-01-11 |
REBUS: A Robust Evaluation Benchmark of Understanding Symbols | ✓ Link | 0.6 | InstructBLIP | 2024-01-11 |