Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs
Open paper
Benchmark
Model
Rank
Results
question-answering-on-piqa
FLAN-T5 (large, 783M) with Similarity-based Router
–
Accuracy: 69.53
Rank counts only results with a code link.