CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AI

Benchmark Model Rank Results
emotion-recognition-in-conversation-on-cpedBERT+AVG+MLP#1Accuracy of Sentiment: 51.50Macro-F1 of Sentiment: 48.02
personality-recognition-in-conversation-on-1BERT$_{ssenet}^{c}$#1Accuracy (%): 67.25Macro-F1: 74.08Accuracy of Neurotism: 53.27
personality-recognition-in-conversation-on-1BERT$^{s}$#2Accuracy (%): 67.23Macro-F1: 72.93Accuracy of Neurotism: 50.75
personality-recognition-in-conversation-on-1BERT$^{c}$#3Accuracy (%): 66.32Macro-F1: 72.69Accuracy of Neurotism: 55.29
personality-recognition-in-conversation-on-1BERT$_{senet}^{c}$#4Accuracy (%): 66.02Macro-F1: 71.89Accuracy of Neurotism: 53.4
personalized-and-emotional-conversation-on-cpedGPT-{emo}#1PPL: 17.48BLEU: 0.1342Distinct-1: 0.0614Distinct-2: 0.3430
personalized-and-emotional-conversation-on-cpedGPT-{per+emo}#2PPL: 17.70BLEU: 0.1403Distinct-1: 0.0602Distinct-2: 0.3388
personalized-and-emotional-conversation-on-cpedGPT-{da}#3PPL: 17.72BLEU: 0.1372Distinct-1: 0.0605Distinct-2: 0.3389
personalized-and-emotional-conversation-on-cpedGPT-{per+emo+da}#4PPL: 17.80BLEU: 0.1382Distinct-1: 0.0601Distinct-2: 0.3404
personalized-and-emotional-conversation-on-cpedGPT-{per}#5PPL: 18.08BLEU: 0.1372Distinct-1: 0.0592Distinct-2: 0.3363
personalized-and-emotional-conversation-on-cpedGPT#6PPL: 20.07BLEU: 0.1171Distinct-1: 0.0482Distinct-2: 0.2738
personalized-and-emotional-conversation-on-cped{emo+da}-GPT#7PPL: 21.60BLEU: 0.1304Distinct-1: 0.0476Distinct-2: 0.2785
personalized-and-emotional-conversation-on-cped{emo+da}-GPT w/o da#8PPL: 22.09BLEU: 0.1272Distinct-1: 0.0473Distinct-2: 0.2790
personalized-and-emotional-conversation-on-cped{emo+da}-GPT w/o emo#9PPL: 22.84BLEU: 0.1252Distinct-1: 0.0451Distinct-2: 0.2746