| logical-reasoning-on-lingoly | Claude Opus | #1 | Delta_NoContext: 28.8%Exact Match Accuracy: 46.3% |
| logical-reasoning-on-lingoly | GPT-4o | #2 | Delta_NoContext: 25.1%Exact Match Accuracy: 37.6% |
| logical-reasoning-on-lingoly | Gemini 1.5 Pro | #3 | Delta_NoContext: 23.4%Exact Match Accuracy: 32.1% |
| logical-reasoning-on-lingoly | GPT-4 | #4 | Delta_NoContext: 21.5%Exact Match Accuracy: 33.4% |
| logical-reasoning-on-lingoly | Command R+ | #5 | Delta_NoContext: 11.6%Exact Match Accuracy: 21.5% |
| logical-reasoning-on-lingoly | GPT-3.5 | #6 | Delta_NoContext: 11.2%Exact Match Accuracy: 21.2% |
| logical-reasoning-on-lingoly | Mixtral 8x7B | #7 | Delta_NoContext: 6.4%Exact Match Accuracy: 14.2% |
| logical-reasoning-on-lingoly | Llama 3 8B | #8 | Delta_NoContext: 4.9%Exact Match Accuracy: 11.4% |
| logical-reasoning-on-lingoly | Llama 3 70B | #9 | Delta_NoContext: 2.9%Exact Match Accuracy: 10.3% |
| logical-reasoning-on-lingoly | Gemma 7B | #10 | Delta_NoContext: 2.2%Exact Match Accuracy: 4.9% |
| logical-reasoning-on-lingoly | Llama 2 70B | #11 | Delta_NoContext: 1.1%Exact Match Accuracy: 6.4% |