FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search

Benchmark Model Rank Results
image-classification-on-imagenetFairNAS-A#890Top 1 Accuracy: 75.34%Number of params: 4.6MGFLOPs: 0.776
image-classification-on-imagenetFairNAS-B#898Top 1 Accuracy: 75.10%Number of params: 4.5MGFLOPs: 0.690
image-classification-on-imagenetFairNAS-C#911Top 1 Accuracy: 74.69%Number of params: 4.4MGFLOPs: 0.642
neural-architecture-search-on-cifar-10FairNAS-A#3Top-1 Error Rate: 1.8%Parameters: 3FLOPS: 391
neural-architecture-search-on-imagenetFairNAS-A#98Top-1 Error Rate: 24.7Accuracy: 75.34Params: 4.6MMACs: 388M
neural-architecture-search-on-imagenetFairNAS-B#101Top-1 Error Rate: 24.9Accuracy: 75.1Params: 4.5MMACs: 345M
neural-architecture-search-on-imagenetFairNAS-C#105Top-1 Error Rate: 25.4Accuracy: 74.69Params: 4.4MMACs: 321M
neural-architecture-search-on-nas-bench-201FairNAS#26Accuracy (Test): 42.19Search time (s): 9845
neural-architecture-search-on-nas-bench-201-1FairNAS#20Accuracy (Test): 93.23Accuracy (Val): 90.07Search time (s): 9845
neural-architecture-search-on-nas-bench-201-2FairNAS#19Accuracy (Test): 71.00Accuracy (Val): 70.94Search time (s): 9845
neural-architecture-search-on-nats-benchFairNAS (Chu et al., 2021)#4Test Accuracy: 42.19
neural-architecture-search-on-nats-bench-1FairNAS (Chu et al., 2021)#4Test Accuracy: 93.23
neural-architecture-search-on-nats-bench-2FairNAS (Chu et al., 2021)#4Test Accuracy: 71.00