Do Transformers Really Perform Bad for Graph Representation?

Benchmark Model Rank Results
graph-classification-on-imdb-bGraphormer#14Accuracy: 77.500±2.646
graph-classification-on-nci1Graphormer#40Accuracy: 77.032±1.393
graph-classification-on-nci109Graphormer#23Accuracy: 74.879±1.183
graph-property-prediction-on-ogbg-molhivGraphormer + FPs#3Test ROC-AUC: 0.8225 ± 0.0001Ext. data: No
graph-property-prediction-on-ogbg-molhivGraphormer#9Test ROC-AUC: 0.8051 ± 0.0053Ext. data: Yes
graph-property-prediction-on-ogbg-molhivGraphormer (pre-trained on PCQM4M)#10Test ROC-AUC: 0.8051 ± 0.0053Ext. data: Yes
graph-property-prediction-on-ogbg-molpcbaGraphormer#2Test AP: 0.3140 ± 0.0032Validation AP: 0.3227 ± 0.0024
graph-property-prediction-on-ogbg-molpcbaGraphormer (pre-trained on PCQM4M)#3Test AP: 0.3140 ± 0.0032Ext. data: YesValidation AP: 0.3227 ± 0.0024
graph-regression-on-esr2Graphormer#9R2: OOMRMSE: OOM
graph-regression-on-f2Graphormer#9R2: OOMRMSE: OOM
graph-regression-on-kitGraphormer#9R2: OOMRMSE: OOM
graph-regression-on-lipophilicityGraphormer#14RMSE: 0.791±0.048R2: 0.607±0.048
graph-regression-on-parp1Graphormer#9R2: OOMRMSE: OOM
graph-regression-on-pcqm4m-lscGraphormer#1Test MAE: 13.28Validation MAE: 0.1234
graph-regression-on-pcqm4mv2-lscGraphormer#13Validation MAE: 0.0864
graph-regression-on-pgrGraphormer#9R2: OOMRMSE: OOM
graph-regression-on-zinc-500kGraphormer-SLIM#24MAE: 0.122
graph-regression-on-zinc-fullGraphormer#10Test MAE: 0.036±0.002
molecular-property-prediction-on-esolGraphormer#10RMSE: 0.618±0.068R2: 0.908±0.021
molecular-property-prediction-on-freesolvGraphormer#9RMSE: 1.065±0.039R2: 0.927±0.005