BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation

Benchmark Model Rank Results
open-information-extraction-on-benchieClausIE#1Precision: 0.50F1: 0.34Recall: 0.26
open-information-extraction-on-benchieMinIE#2Precision: 0.43Recall: 0.28
open-information-extraction-on-benchieM2OIE (EN)#4Precision: 0.39F1: 0.23
open-information-extraction-on-benchieROIE-T#5Precision: 0.37F1: 0.13Recall: 0.08
open-information-extraction-on-benchieOpenIE6#6Precision: 0.31F1: 0.25Recall: 0.21
open-information-extraction-on-benchieM2OIE (ZH)#7Precision: 0.26F1: 0.17Recall: 0.13
open-information-extraction-on-benchieROIE-N#8Precision: 0.20F1: 0.13Recall: 0.09
open-information-extraction-on-benchieStanford OIE#9Precision: 0.11F1: 0.13Recall: 0.16
open-information-extraction-on-benchieM2OIE (DE)#10Precision: 0.09F1: 0.04Recall: 0.03
open-information-extraction-on-benchieNaive OIE#11Precision: 0.03F1: 0.03Recall: 0.02