Bifrost-1: Bridging Multimodal LLMs and Diffusion Models with Patch-level CLIP Latents

Benchmark Model Rank Results
text-to-image-generation-on-genevalBifrost-1 (Qwen2.5-VL 3B, 9M)–Overall: 0.61
text-to-image-generation-on-genevalBifrost-1 (Qwen2.5-VL 7B, 62M)–Overall: 0.81
visual-question-answering-on-mm-vetBifrost-1–GPT-4 score: 66.6