The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training

Benchmark Model Rank Results
common-sense-reasoning-on-arc-easyQwen3-0.6B (Averis FP4)–Accuracy: 50.72
language-modelling-on-lambadaQwen3-0.6B (Averis FP4)–Accuracy: 38.62
question-answering-on-boolqQwen3-0.6B (Averis FP4)–Accuracy: 57.46
question-answering-on-piqaQwen3-0.6B (Averis FP4)–Accuracy: 66.7
reading-comprehension-on-raceQwen3-0.6B (Averis FP4)–Accuracy: 50.3600
sentence-completion-on-hellaswagQwen3-0.6B (Averis FP4)–Accuracy: 37.51