SHAKTI: A 2.5 Billion Parameter Small Language Model Optimized for Edge AI and Low-Resource Environments

Benchmark Model Rank Results
question-answering-on-boolqShakti-LLM (2.5B)Accuracy: 61.1
question-answering-on-medqa-usmleShakti-LLM (2.5B)Accuracy: 60.3
question-answering-on-piqaShakti-LLM (2.5B)Accuracy: 86.2
question-answering-on-triviaqaShakti-LLM (2.5B)EM: 58.2
question-answering-on-truthfulqaShakti-LLM (2.5B)Accuracy: 68.4