Sparse-BitNet: 1.58-bit LLMs are Naturally Friendly to Semi-Structured Sparsity

Benchmark Model Rank Results
common-sense-reasoning-on-arc-easySparse-BitNet (Qwen2.5-3B, 6:8)#89Accuracy: 47.32
question-answering-on-boolqSparse-BitNet (Qwen2.5-3B, 6:8)#116Accuracy: 51.35
question-answering-on-piqaSparse-BitNet (Qwen2.5-3B, 6:8)#144Accuracy: 71.93
sentence-completion-on-hellaswagSparse-BitNet (Qwen2.5-3B, 6:8)#176Accuracy: 51.2