NITP: Next Implicit Token Prediction for LLM Pre-training
Open paper
Benchmark
Model
Rank
Results
multi-task-language-understanding-on-mmlu-pro
9B MoE (NITP)
#131
Accuracy: 21.0
Rank counts only results with a code link.