MiniLLM: Knowledge Distillation of Large Language Models

Benchmark Model Rank Results
passage-retrieval-on-peerqaMiniLM-L12-v2#3Recall@10: 0.6709MRR: 0.4839