Breaking the Ceiling of the LLM Community by Treating Token Generation as a Classification for Ensembling

Benchmark Model Rank Results
question-answering-on-triviaqaGaC(Qwen2-72B-Instruct + Llama-3-70B-Instruct)#9EM: 79.29
arithmetic-reasoning-on-gsm8kGaC(Qwen2-72B-Instruct + Llama-3-70B-Instruct)#66Accuracy: 90.91