LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

Benchmark Model Rank Results
image-classification-on-coloninst-v1-seenLLaVA-Med-v1.0 (w/o LoRA, w/ extra data)#2Accuray: 93.84
image-classification-on-coloninst-v1-seenLLaVA-Med-v1.5 (w/ LoRA, w/o extra data)#4Accuray: 93.62
image-classification-on-coloninst-v1-seenLLaVA-Med-v1.0 (w/o LoRA, w/o extra data)#5Accuray: 93.52
image-classification-on-coloninst-v1-seenLLaVA-Med-v1.5 (w/ LoRA, w/ extra data)#17Accuray: 87.22
image-classification-on-coloninst-v1-unseenLLaVA-Med-v1.5 (w/ LoRA, w/o extra data)#5Accuray: 79.24
image-classification-on-coloninst-v1-unseenLLaVA-Med-v1.0 (w/o LoRA, w/o extra data)#10Accuray: 78.04
image-classification-on-coloninst-v1-unseenLLaVA-Med-v1.0 (w/o LoRA, w/ extra data)#12Accuray: 77.38
image-classification-on-coloninst-v1-unseenLLaVA-Med-v1.5 (w/ LoRA, w/ extra data)#16Accuray: 66.51
referring-expression-generation-on-coloninstLLaVA-Med-v1.5 (w/ LoRA, w/o extra data)#3Accuray: 99.3
referring-expression-generation-on-coloninstLLaVA-Med-v1.0 (w/o LoRA, w/o extra data)#9Accuray: 97.74
referring-expression-generation-on-coloninstLLaVA-Med-v1.0 (w/o LoRA, w/ extra data)#10Accuray: 97.35
referring-expression-generation-on-coloninstLLaVA-Med-v1.5 (w/ LoRA, w/ extra data)#14Accuray: 90.4
referring-expression-generation-on-coloninst-1LLaVA-Med-v1.0 (w/o LoRA, w/ extra data)#3Accuray: 75.25
referring-expression-generation-on-coloninst-1LLaVA-Med-v1.0 (w/o LoRA, w/o extra data)#5Accuray: 75.07
referring-expression-generation-on-coloninst-1LLaVA-Med-v1.5 (w/ LoRA, w/o extra data)#8Accuray: 73.05
referring-expression-generation-on-coloninst-1LLaVA-Med-v1.5 (w/ LoRA, w/ extra data)#13Accuray: 70.00