HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles

Open paper
Benchmark Model Rank Results
document-summarization-on-howsumm-methodLexRank (query: method + article + steps titles)#1ROUGE-1: 53.5
document-summarization-on-howsumm-methodCES (query: method + article + steps titles)#2ROUGE-1: 52.2
document-summarization-on-howsumm-methodGreedyRel (query: method + article + steps titles)#3ROUGE-1: 48.6
document-summarization-on-howsumm-methodCES (query: method title)#4ROUGE-1: 48.4
document-summarization-on-howsumm-methodCES (query: method + article titles)#5ROUGE-1: 48.3
document-summarization-on-howsumm-methodLexRank (query: method title)#6ROUGE-1: 47.7
document-summarization-on-howsumm-methodLexRank (query: method + article titles)#7ROUGE-1: 47.1
document-summarization-on-howsumm-methodGreedyRel (query: method title)#8ROUGE-1: 43.4
document-summarization-on-howsumm-methodGreedyRel (query: method + article titles)#9ROUGE-1: 42.3
document-summarization-on-howsumm-stepLexRank (query: step title)#1ROUGE-1: 39.6
document-summarization-on-howsumm-stepCES (query: step title)#2ROUGE-1: 39.3
document-summarization-on-howsumm-stepCES (query: step + method titles)#3ROUGE-1: 38.3
document-summarization-on-howsumm-stepLexRank (query: step + method titles)#4ROUGE-1: 38.2
document-summarization-on-howsumm-stepCES (query: step + method + article titles)#5ROUGE-1: 37.0
document-summarization-on-howsumm-stepLexRank (query: step + method + article titles)#6ROUGE-1: 36.3
document-summarization-on-howsumm-stepGreedyRel (query: step + method titles)#7ROUGE-1: 30.3
document-summarization-on-howsumm-stepGreedyRel (query: step title)#8ROUGE-1: 30.1
document-summarization-on-howsumm-stepBM25-HierSumm (query: step + method titles)#9ROUGE-1: 23.0
document-summarization-on-howsumm-stepBM25-HierSumm (query: step title)#10ROUGE-1: 22.3
document-summarization-on-howsumm-stepBM25-HierSumm (query: step + method + article titles)#11ROUGE-1: 21.9

Rank counts only results with a code link.