CoDEx: A Comprehensive Knowledge Graph Completion Benchmark

Benchmark Model Rank Results
link-prediction-on-codexTuckER#2MRR: 0.444Hits@1: 0.372Hits@3: 0.5038Hits@10: 0.646
link-prediction-on-codexConvE#3MRR: 0.444Hits@1: 0.219Hits@3: 0.4218Hits@10: 0.634
link-prediction-on-codexRESCAL#4MRR: 0.404Hits@1: 0.343Hits@3: 0.4926Hits@10: 0.635
link-prediction-on-codexComplEx#5MRR: 0.404Hits@1: 0.293Hits@3: 0.4494Hits@10: 0.623
link-prediction-on-codexTransE#6MRR: 0.354Hits@1: 0.339Hits@3: 0.4975Hits@10: 0.638
link-prediction-on-codex-largeTuckER#2MRR: 0.309Hits@1: 0.244Hits@3: 0.3395Hits@10: 0.430
link-prediction-on-codex-largeRESCAL#3MRR: 0.304Hits@1: 0.242Hits@3: 0.3313Hits@10: 0.419
link-prediction-on-codex-largeConvE#4MRR: 0.303Hits@1: 0.240Hits@3: 0.3298Hits@10: 0.420
link-prediction-on-codex-largeComplEx#5MRR: 0.294Hits@1: 0.237Hits@3: 0.3179Hits@10: 0.400
link-prediction-on-codex-largeTransE#6MRR: 0.187Hits@1: 0.116Hits@3: 0.2188Hits@10: 0.317
link-prediction-on-codex-mediumComplEx#3MRR: 0.337Hits@1: 0.244Hits@3: 0.3477Hits@10: 0.456
link-prediction-on-codex-mediumTuckER#4MRR: 0.328Hits@1: 0.223Hits@3: 0.3363Hits@10: 0.454
link-prediction-on-codex-mediumConvE#5MRR: 0.318Hits@1: 0.262Hits@3: 0.3701Hits@10: 0.476
link-prediction-on-codex-mediumRESCAL#6MRR: 0.317Hits@1: 0.239Hits@3: 0.3551Hits@10: 0.464
link-prediction-on-codex-mediumTransE#7MRR: 0.303Hits@1: 0.259Hits@3: 0.3599Hits@10: 0.458