FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search

Benchmark Model Rank Results
neural-architecture-search-on-cifar-10FairNAS-A#3Top-1 Error Rate: 1.8%Parameters: 3FLOPS: 391…
neural-architecture-search-on-nats-bench-topology-cifar-10FairNAS (Chu et al., 2021)#4Test Accuracy: 93.23
neural-architecture-search-on-nats-bench-topology-cifar-100FairNAS (Chu et al., 2021)#4Test Accuracy: 71.00
neural-architecture-search-on-nats-bench-topology-imagenet16-120FairNAS (Chu et al., 2021)#4Test Accuracy: 42.19
neural-architecture-search-on-nas-bench-201-cifar-100FairNAS#19Accuracy (Test): 71.00Accuracy (Val): 70.94Search time (s): 9845
neural-architecture-search-on-nas-bench-201-cifar-10FairNAS#20Accuracy (Test): 93.23Accuracy (Val): 90.07Search time (s): 9845
neural-architecture-search-on-nas-bench-201-imagenet-16-120FairNAS#26Accuracy (Test): 42.19Search time (s): 9845
neural-architecture-search-on-imagenetFairNAS-A#98Top-1 Error Rate: 24.7Accuracy: 75.34Params: 4.6MMACs: 388M
neural-architecture-search-on-imagenetFairNAS-B#101Top-1 Error Rate: 24.9Accuracy: 75.1Params: 4.5MMACs: 345M
neural-architecture-search-on-imagenetFairNAS-C#105Top-1 Error Rate: 25.4Accuracy: 74.69Params: 4.4MMACs: 321M
image-classification-on-imagenetFairNAS-A#992Top 1 Accuracy: 75.34%Number of params: 4.6MGFLOPs: 0.776
image-classification-on-imagenetFairNAS-B#1001Top 1 Accuracy: 75.10%Number of params: 4.5MGFLOPs: 0.690
image-classification-on-imagenetFairNAS-C#1015Top 1 Accuracy: 74.69%Number of params: 4.4MGFLOPs: 0.642