Count-Based Exploration with Neural Density Models

Benchmark Model Rank Results
atari-games-on-atari-2600-montezumas-revengeDQN-PixelCNN#8Score: 3705.5
atari-games-on-atari-2600-private-eyeDQN-PixelCNN#9Score: 8358.7
atari-games-on-atari-2600-private-eyeDQN-CTS#31Score: 206.0
atari-games-on-atari-2600-freewayDQN-CTS#15Score: 33.0
atari-games-on-atari-2600-freewayDQN-PixelCNN#24Score: 31.7
atari-games-on-atari-2600-gravitarDQN-PixelCNN#28Score: 498.3
atari-games-on-atari-2600-gravitarDQN-CTS#46Score: 238.0
atari-games-on-atari-2600-ventureDQN-PixelCNN#30Score: 82.2
atari-games-on-atari-2600-ventureDQN-CTS#34Score: 48.0