MERGETUNE: Continued Fine-Tuning of Vision-Language Models

Open paper
Benchmark Model Rank Results
prompt-engineering-on-fgvc-aircraftPromptKD + MergeTune#1Harmonic mean: 45.76
prompt-engineering-on-fgvc-aircraftMMA + MergeTune#17Harmonic mean: 39.14
prompt-engineering-on-fgvc-aircraftKgCoOp + MergeTune#24Harmonic mean: 36.07
prompt-engineering-on-fgvc-aircraftCoOp + MergeTune#27Harmonic mean: 35.24
prompt-engineering-on-imagenetPromptKD + MergeTune#1Harmonic mean: 77.77
prompt-engineering-on-imagenetMMA + MergeTune#17Harmonic mean: 74.00
prompt-engineering-on-imagenetCoOp + MergeTune#24Harmonic mean: 72.81
prompt-engineering-on-imagenetKgCoOp + MergeTune#25Harmonic mean: 72.75
prompt-engineering-on-oxford-iiit-pet-datasetPromptKD + MergeTune#1Harmonic mean: 97.48
prompt-engineering-on-oxford-iiit-pet-datasetMMA + MergeTune#6Harmonic mean: 96.91
prompt-engineering-on-oxford-iiit-pet-datasetKgCoOp + MergeTune#15Harmonic mean: 96.53
prompt-engineering-on-oxford-iiit-pet-datasetCoOp + MergeTune#20Harmonic mean: 96.40
prompt-engineering-on-stanford-carsPromptKD + MergeTune#1Harmonic mean: 83.44
prompt-engineering-on-stanford-carsMMA + MergeTune#12Harmonic mean: 76.51
prompt-engineering-on-stanford-carsKgCoOp + MergeTune#22Harmonic mean: 74.17
prompt-engineering-on-stanford-carsCoOp + MergeTune#24Harmonic mean: 73.49
prompt-engineering-on-caltech-101PromptKD + MergeTune#2Harmonic mean: 97.77
prompt-engineering-on-caltech-101MMA + MergeTune#14Harmonic mean: 96.45
prompt-engineering-on-caltech-101KgCoOp + MergeTune#15Harmonic mean: 96.37
prompt-engineering-on-caltech-101CoOp + MergeTune#20Harmonic mean: 96.25
prompt-engineering-on-dtdPromptKD + MergeTune#2Harmonic mean: 78.76
prompt-engineering-on-dtdMMA + MergeTune#10Harmonic mean: 73.26
prompt-engineering-on-dtdKgCoOp + MergeTune#24Harmonic mean: 66.75
prompt-engineering-on-dtdCoOp + MergeTune#25Harmonic mean: 65.93
prompt-engineering-on-oxford-102-flowerPromptKD + MergeTune#2Harmonic mean: 90.23
prompt-engineering-on-oxford-102-flowerMMA + MergeTune#13Harmonic mean: 85.83
prompt-engineering-on-oxford-102-flowerKgCoOp + MergeTune#20Harmonic mean: 84.20
prompt-engineering-on-oxford-102-flowerCoOp + MergeTune#22Harmonic mean: 83.51
prompt-engineering-on-sun397PromptKD + MergeTune#2Harmonic mean: 82.69
prompt-engineering-on-sun397MMA + MergeTune#17Harmonic mean: 80.42
prompt-engineering-on-sun397KgCoOp + MergeTune#22Harmonic mean: 78.87
prompt-engineering-on-sun397CoOp + MergeTune#24Harmonic mean: 78.22
prompt-engineering-on-eurosatPromptKD + MergeTune#4Harmonic mean: 90.28
prompt-engineering-on-eurosatMMA + MergeTune#13Harmonic mean: 85.81
prompt-engineering-on-eurosatKgCoOp + MergeTune#23Harmonic mean: 77.22
prompt-engineering-on-eurosatCoOp + MergeTune#26Harmonic mean: 73.40

Rank counts only results with a code link.