| Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision | ✓ Link | 79.99 | ALIGN (50 hypers/task) | 2021-02-11 |
| Big Transfer (BiT): General Visual Representation Learning | ✓ Link | 78.72 | BiT-L (50 hypers/task) | 2019-12-24 |
| Scaling Vision Transformers | ✓ Link | 78.29 | ViT-G/14 | 2021-06-08 |
| PVP: Pre-trained Visual Parameter-Efficient Tuning | | 78.02 | PVP(VIT-Base) | 2023-04-26 |
| Deep Ensembles for Low-Data Transfer Learning | | 77.6 | ExpertEnsembles R101 | 2020-10-14 |
| Big Transfer (BiT): General Visual Representation Learning | ✓ Link | 76.3 | BiT-L | 2019-12-24 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 72.7 | S4L-Exemplar-ResNet50-LargeHyperSweep | 2019-10-01 |
| Scalable Transfer Learning with Expert Models | | 72.3 | ScalableExperts (I21k+JFT) | 2020-09-28 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 71.5 | S4L-Rotation-ResNet50-LargeHyperSweep | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 71.2 | ImageNet-ResNet50-LargeHyperSweep | 2019-10-01 |
| Big Transfer (BiT): General Visual Representation Learning | ✓ Link | 70.6 | BiT-M | 2019-12-24 |
| Self-Supervised Learning of Video-Induced Visual Invariances | | 70.4 | VIVI-Ex4-Co | 2019-12-05 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 67.5 | S4L-Rotation-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 67.0 | S4L-Exemplar-ResNet50 | 2019-10-01 |
| Big Transfer (BiT): General Visual Representation Learning | ✓ Link | 66.9 | BiT-S | 2019-12-24 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 65.6 | ImageNet-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 64.8 | S4L-10%-Rotation-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 63.9 | S4L-10%-Exemplar-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 61.6 | ImageNet-10%-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 59.5 | SelfSup-Rotation-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 59.2 | ResNet50-LargeHyperSweep | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 59.1 | BigBiGAN-ResNet50 | 2019-10-01 |
| Contextual Squeeze-and-Excitation for Efficient Few-Shot Image Classification | ✓ Link | 58.4 | UpperCaSE-EfficientNetB0 | 2022-06-20 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 57.5 | SelfSup-Exemplar-ResNet50 | 2019-10-01 |
| Contextual Squeeze-and-Excitation for Efficient Few-Shot Image Classification | ✓ Link | 56.6 | UpperCaSE-ResNet50 | 2022-06-20 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 51.1 | SelfSup-Jigsaw-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 50.8 | SelfSup-RelativePatchLoc-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 44.0 | Unconditional-BigGAN-ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 42.1 | ResNet50 | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 37.5 | VAE | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 37.3 | WAE-MMD | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 35.3 | Conditional-BigGAN | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 32.0 | WAE-GAN | 2019-10-01 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark | ✓ Link | 31.0 | WAE-UKL | 2019-10-01 |