TACO: Learning Multi-modal Action Models with Synthetic Chains-of-Thought-and-Action

Open paper
Benchmark Model Rank Results
visual-question-answering-on-mm-vetTACO (Qwen2-7B / SigLIP)#66GPT-4 score: 50.9
visual-question-answering-on-mm-vetTACO (LLaMA3-8B / SigLIP)#80GPT-4 score: 45.7
visual-question-answering-on-mm-vetTACO (LLaMA3-8B / CLIP)#81GPT-4 score: 45.2

Rank counts only results with a code link.