TIPSv2: Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment

Benchmark Model Rank Results
zero-shot-cross-modal-retrieval-on-coco-2014TIPSv2 g/14#1Image-to-text R@1: 75.7
zero-shot-cross-modal-retrieval-on-flickr30kTIPSv2 g/14#25Text-to-image R@1: 85.9
image-classification-on-imagenetTIPSv2 g/14 + Linear Probe#132Top 1 Accuracy: 86.8%