ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks

Benchmark Model Rank Results
multiple-choice-question-answering-mcqa-on-arc-eParameterNet-MoE-up-proj-8#22Accuracy: 49.58
question-answering-on-boolqParameterNet-MoE-down-proj-8#107Accuracy: 58.58
sentence-completion-on-hellaswagParameterNet-MoE-up-proj-8#191Accuracy: 44.21
image-classification-on-imagenetParameterNet-600M#665Top 1 Accuracy: 81.6%