An end-to-end attention-based approach for learning on graphs

Benchmark Model Rank Results
graph-classification-on-cifar10-100kESA (Edge set attention, no positional encodings)#6Accuracy (%): 75.413±0.248
graph-classification-on-ddESA (Edge set attention, no positional encodings)#3Accuracy: 83.529±1.743
graph-classification-on-enzymesESA (Edge set attention, no positional encodings)#1Accuracy: 79.423±1.658
graph-classification-on-imdb-bESA (Edge set attention, no positional encodings)#2Accuracy: 86.250±0.957
graph-classification-on-malnet-tinyESA (Edge set attention, no positional encodings)#1Accuracy: 94.800±0.424MCC: 0.935±0.005
graph-classification-on-mnistESA (Edge set attention, no positional encodings, tuned)#1Accuracy: 98.917±0.020
graph-classification-on-mnistESA (Edge set attention, no positional encodings)#3Accuracy: 98.753±0.041
graph-classification-on-nci1ESA (Edge set attention, no positional encodings)#2Accuracy: 87.835±0.644
graph-classification-on-nci109ESA (Edge set attention, no positional encodings)#2Accuracy: 84.976±0.551
graph-classification-on-peptides-funcESA + RWSE (Edge set attention, Random Walk Structural Encoding, + validation set)#1AP: 0.7479
graph-classification-on-peptides-funcESA + RWSE (Edge set attention, Random Walk Structural Encoding, tuned)#3AP: 0.7357±0.0036
graph-classification-on-peptides-funcESA (Edge set attention, no positional encodings, tuned)#13AP: 0.7071±0.0015
graph-classification-on-peptides-funcESA (Edge set attention, no positional encodings, not tuned)#19AP: 0.6863±0.0044
graph-classification-on-proteinsESA (Edge set attention, no positional encodings)#4Accuracy: 82.679±0.799
graph-regression-on-esr2ESA (Edge set attention, no positional encodings)#1R2: 0.697±0.000RMSE: 0.486±0.697
graph-regression-on-f2ESA (Edge set attention, no positional encodings)#2R2: 0.891±0.000RMSE: 0.335±0.891
graph-regression-on-kitESA (Edge set attention, no positional encodings)#2R2: 0.841±0.000RMSE: 0.433±0.841
graph-regression-on-lipophilicityESA (Edge set attention, no positional encodings)#6RMSE: 0.552±0.012R2: 0.809±0.008
graph-regression-on-parp1ESA (Edge set attention, no positional encodings)#1R2: 0.925±0.000RMSE: 0.343±0.925
graph-regression-on-pcqm4mv2-lscESA (Edge set attention, no positional encodings)#1Validation MAE: 0.0235Test MAE: N/A
graph-regression-on-peptides-structESA + RWSE (Edge set attention, Random Walk Structural Encoding, tuned)#1MAE: 0.2393±0.0004
graph-regression-on-peptides-structESA (Edge set attention, no positional encodings, not tuned)#8MAE: 0.2453±0.0003
graph-regression-on-pgrESA (Edge set attention, no positional encodings)#1R2: 0.725±0.000RMSE: 0.507±0.725
graph-regression-on-zincESA + rings + NodeRWSE + EdgeRWSE#1MAE: 0.051
graph-regression-on-zinc-500kESA + rings + NodeRWSE + EdgeRWSE#1MAE: 0.051
graph-regression-on-zinc-fullESA + rings + NodeRWSE + EdgeRWSE#1Test MAE: 0.0109±0.0002
graph-regression-on-zinc-fullESA + RWSE + CY2C (Edge set attention, Random Walk Structural Encoding, clique adjacency, tuned)#2Test MAE: 0.0122±0.0004
graph-regression-on-zinc-fullESA + RWSE (Edge set attention, Random Walk Structural Encoding, tuned)#4Test MAE: 0.0154±0.0001
graph-regression-on-zinc-fullESA + RWSE (Edge set attention, Random Walk Structural Encoding)#5Test MAE: 0.017±0.001
graph-regression-on-zinc-fullESA (Edge set attention, no positional encodings)#9Test MAE: 0.027±0.001
molecular-property-prediction-on-esolESA (Edge set attention, no positional encodings)#1RMSE: 0.485±0.009R2: 0.944±0.002
molecular-property-prediction-on-freesolvESA (Edge set attention, no positional encodings)#1RMSE: 0.595±0.013R2: 0.977±0.001