MiLe Loss: a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
Open paper
Benchmark
Model
Rank
Results
multi-task-language-understanding-on-mmlu
LLaMA7B-MiLe-Loss(5-shot)
#34
Average (%): 29.68
Rank counts only results with a code link.