R2 Loss: Range Restriction Loss for Model Compression and Quantization

Benchmark Model Rank Results
model-compression-on-imagenetMobileNet-v1 + 1bit-1dim model compression using DKMTop-1: 52.58
model-compression-on-imagenetMobileNet-v1 + 2bit-1dim model compression using DKMTop-1: 67.62
model-compression-on-imagenetMobileNet-v1 + 2bit-2dim model compression using DKMTop-1: 53.99
model-compression-on-imagenetMobileNet-v1 + 4bit-1dim model compression using DKMTop-1: 69.63
model-compression-on-imagenetMobileNet-v1 + 4bit-4dim model compression using DKMTop-1: 61.4
model-compression-on-imagenetResNet-18 + 1bit-1dim model compression using DKMTop-1: 59.7
model-compression-on-imagenetResNet-18 + 2bit-1dim model compression using DKMTop-1: 68.63
model-compression-on-imagenetResNet-18 + 2bit-2dim model compression using DKMTop-1: 64.7
model-compression-on-imagenetResNet-18 + 4bit-1dim model compression using DKMTop-1: 70.52
model-compression-on-imagenetResNet-18 + 4bit-4dim model compression using DKMTop-1: 66.1
quantization-on-imagenetMobileNet-v1 + EWGS + R2LossTop-1 Accuracy (%): 69.79Weight bits: 4
quantization-on-imagenetMobileNet-v1 + LSQ + R2LossTop-1 Accuracy (%): 69.64
quantization-on-imagenetResNet-18 + PACT + R2LossTop-1 Accuracy (%): 68.45Weight bits: 2Activation bits: 4