No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval

Benchmark Model Rank Results
biomedical-information-retrieval-on-bioasq-1monoT5-3B#1nDCG@10: 0.579
biomedical-information-retrieval-on-nfcorpus-1monoT5-3B#1nDCG@10: 0.383
biomedical-information-retrieval-on-trec-1monoT5-3B#2nDCG@10: 0.795
fact-checking-on-climate-fever-beirmonoT5-3B#2nDCG@10: 0.280
fact-checking-on-fever-beirmonoT5-3B#1nDCG@10: 0.849
fact-checking-on-scifact-beirmonoT5-3B#1nDCG@10: 0.777
question-answering-on-fiqa-2018-beirmonoT5-3B#1nDCG@10: 0.513
question-answering-on-hotpotqa-beirmonoT5-3B#1nDCG@10: 0.759
question-answering-on-nq-beirmonoT5-3B#2nDCG@10: 0.633