TIPS: Text-Image Pretraining with Spatial Awareness

Benchmark Model Rank Results
zero-shot-cross-modal-retrieval-on-coco-2014TIPS-g/14 HR#4Image-to-text R@1: 74.0
zero-shot-cross-modal-retrieval-on-flickr30kTIPS-SO/14 HR#4Image-to-text R@1: 94.2
zero-shot-cross-modal-retrieval-on-flickr30kTIPS-g/14 HR#24Text-to-image R@1: 84.5
linear-probe-semantic-segmentation-on-ade20kTIPS-SO/14 HR + Linear Probe#6mIoU: 49.7
image-classification-on-imagenetTIPS-g/14 LR (linear probe)#175Top 1 Accuracy: 86.3%