A Synthetic Dataset for Personal Attribute Inference

Benchmark Model Rank Results
personality-trait-recognition-on-synthpaiGPT-4#1Average accuracy in %: 77.9%
personality-trait-recognition-on-synthpaiLLama-3 70B#2Average accuracy in %: 72.2%
personality-trait-recognition-on-synthpaiMixtral 8x22B#3Average accuracy in %: 72%
personality-trait-recognition-on-synthpaiClaude-3 Opus#4Average accuracy in %: 71.1%
personality-trait-recognition-on-synthpaiClaude-3 Sonnet#5Average accuracy in %: 70.9%
personality-trait-recognition-on-synthpaiGemini 1.5 Pro#6Average accuracy in %: 67.5%
personality-trait-recognition-on-synthpaiQwen1.5 110B#7Average accuracy in %: 65.7%
personality-trait-recognition-on-synthpaiGemini 1.0 Pro#8Average accuracy in %: 64.6%
personality-trait-recognition-on-synthpaiClaude-3 Haiku#9Average accuracy in %: 64%
personality-trait-recognition-on-synthpaiYi 34B#10Average accuracy in %: 57.7%
personality-trait-recognition-on-synthpaiLLama-2 70B#11Average accuracy in %: 56.8%
personality-trait-recognition-on-synthpaiGPT-3.5#12Average accuracy in %: 55.9%
personality-trait-recognition-on-synthpaiLLama-3 8B#13Average accuracy in %: 53.5%
personality-trait-recognition-on-synthpaiMixtral 8x7B#14Average accuracy in %: 52.3%
personality-trait-recognition-on-synthpaiLLama-2 13B#15Average accuracy in %: 48.7%
personality-trait-recognition-on-synthpaiMistral 7B#16Average accuracy in %: 42.4%
personality-trait-recognition-on-synthpaiGemma 7B#17Average accuracy in %: 34.9%
personality-trait-recognition-on-synthpaiLLama-2 7B#18Average accuracy in %: 33%