BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine

Benchmark Model Rank Results
multiple-choice-question-answering-mcqa-on-mmlu-professional-medicineBioMedGPT-LM-7B#4Accuracy: 51.1
zero-shot-learning-on-medconceptsqaPharMolix/BioMedGPT-LM-7B#9Accuracy: 24.747
few-shot-learning-on-medconceptsqaPharMolix/BioMedGPT-LM-7B#10Accuracy: 24.924
multiple-choice-question-answering-mcqa-on-medmcqaBioMedGPT-10B#11Test Set (Acc-%): 0.514
question-answering-on-medqa-usmleBioMedGPT-10B#14Accuracy: 50.4
question-answering-on-pubmedqaBioMedGPT-10B#15Accuracy: 76.1