| atari-games-on-atari-2600-alien | DQN noop | #26 | Score: 1620.0 |
| atari-games-on-atari-2600-alien | DDQN (tuned) hs | #33 | Score: 1033.4 |
| atari-games-on-atari-2600-alien | Prior+Duel hs | #37 | Score: 823.7 |
| atari-games-on-atari-2600-alien | DQN hs | #40 | Score: 634.0 |
| atari-games-on-atari-2600-amidar | DQN noop | #23 | Score: 978.0 |
| atari-games-on-atari-2600-amidar | Prior+Duel hs | #30 | Score: 238.4 |
| atari-games-on-atari-2600-amidar | DQN hs | #36 | Score: 178.4 |
| atari-games-on-atari-2600-amidar | DDQN (tuned) hs | #39 | Score: 169.1 |
| atari-games-on-atari-2600-assault | Prior+Duel hs | #15 | Score: 10950.6 |
| atari-games-on-atari-2600-assault | DDQN (tuned) hs | #21 | Score: 6060.8 |
| atari-games-on-atari-2600-assault | DQN noop | #26 | Score: 4280.4 |
| atari-games-on-atari-2600-assault | DQN hs | #30 | Score: 3489.3 |
| atari-games-on-atari-2600-asterix | Prior+Duel hs | #9 | Score: 364200.0 |
| atari-games-on-atari-2600-asterix | DDQN (tuned) hs | #29 | Score: 16837.0 |
| atari-games-on-atari-2600-asterix | DQN noop | #35 | Score: 4359.0 |
| atari-games-on-atari-2600-asterix | DQN hs | #38 | Score: 3170.5 |
| atari-games-on-atari-2600-asteroids | DQN hs | #30 | Score: 1458.7 |
| atari-games-on-atari-2600-asteroids | DQN noop | #31 | Score: 1364.5 |
| atari-games-on-atari-2600-asteroids | DDQN (tuned) hs | #32 | Score: 1193.2 |
| atari-games-on-atari-2600-asteroids | Prior+Duel hs | #35 | Score: 1021.9 |
| atari-games-on-atari-2600-atlantis | Prior+Duel hs | #25 | Score: 423252.0 |
| atari-games-on-atari-2600-atlantis | DDQN (tuned) hs | #30 | Score: 319688.0 |
| atari-games-on-atari-2600-atlantis | DQN hs | #31 | Score: 292491.0 |
| atari-games-on-atari-2600-atlantis | DQN noop | #32 | Score: 279987.0 |
| atari-games-on-atari-2600-bank-heist | Prior+Duel hs | #21 | Score: 1004.6 |
| atari-games-on-atari-2600-bank-heist | DDQN (tuned) hs | #26 | Score: 886.0 |
| atari-games-on-atari-2600-bank-heist | DQN noop | #31 | Score: 455.0 |
| atari-games-on-atari-2600-bank-heist | DQN hs | #34 | Score: 312.7 |
| atari-games-on-atari-2600-battle-zone | Prior+Duel hs | #22 | Score: 30650.0 |
| atari-games-on-atari-2600-battle-zone | DQN noop | #23 | Score: 29900.0 |
| atari-games-on-atari-2600-battle-zone | DDQN (tuned) hs | #30 | Score: 24740.0 |
| atari-games-on-atari-2600-battle-zone | DQN hs | #31 | Score: 23750.0 |
| atari-games-on-atari-2600-beam-rider | Prior+Duel hs | #7 | Score: 37412.2 |
| atari-games-on-atari-2600-beam-rider | DDQN (tuned) hs | #20 | Score: 17417.2 |
| atari-games-on-atari-2600-beam-rider | DQN hs | #29 | Score: 9743.2 |
| atari-games-on-atari-2600-beam-rider | DQN noop | #30 | Score: 8627.5 |
| atari-games-on-atari-2600-berzerk | Prior+Duel hs | #12 | Score: 2178.6 |
| atari-games-on-atari-2600-berzerk | DDQN (tuned) hs | #23 | Score: 1011.1 |
| atari-games-on-atari-2600-berzerk | DQN noop | #32 | Score: 585.6 |
| atari-games-on-atari-2600-berzerk | DQN hs | #34 | Score: 493.4 |
| atari-games-on-atari-2600-bowling | DDQN (tuned) hs | #14 | Score: 69.6 |
| atari-games-on-atari-2600-bowling | DQN hs | #22 | Score: 56.5 |
| atari-games-on-atari-2600-bowling | DQN noop | #25 | Score: 50.4 |
| atari-games-on-atari-2600-bowling | Prior+Duel hs | #26 | Score: 50.4 |
| atari-games-on-atari-2600-boxing | DQN noop | #25 | Score: 88.0 |
| atari-games-on-atari-2600-boxing | Prior+Duel hs | #26 | Score: 79.2 |
| atari-games-on-atari-2600-boxing | DDQN (tuned) hs | #29 | Score: 73.5 |
| atari-games-on-atari-2600-boxing | DQN hs | #32 | Score: 70.3 |
| atari-games-on-atari-2600-breakout | DQN noop | #23 | Score: 385.5 |
| atari-games-on-atari-2600-breakout | DDQN (tuned) hs | #26 | Score: 368.9 |
| atari-games-on-atari-2600-breakout | Prior+Duel hs | #29 | Score: 354.6 |
| atari-games-on-atari-2600-breakout | DQN hs | #30 | Score: 354.5 |
| atari-games-on-atari-2600-centipede | Prior+Duel hs | #23 | Score: 5570.2 |
| atari-games-on-atari-2600-centipede | DQN noop | #26 | Score: 4657.7 |
| atari-games-on-atari-2600-centipede | DQN hs | #31 | Score: 3973.9 |
| atari-games-on-atari-2600-centipede | DDQN (tuned) hs | #33 | Score: 3853.5 |
| atari-games-on-atari-2600-chopper-command | Prior+Duel hs | #18 | Score: 8058.0 |
| atari-games-on-atari-2600-chopper-command | DQN noop | #23 | Score: 6126.0 |
| atari-games-on-atari-2600-chopper-command | DQN hs | #28 | Score: 5017.0 |
| atari-games-on-atari-2600-chopper-command | DDQN (tuned) hs | #35 | Score: 3495.0 |
| atari-games-on-atari-2600-crazy-climber | Prior+Duel hs | #22 | Score: 127853.0 |
| atari-games-on-atari-2600-crazy-climber | DDQN (tuned) hs | #29 | Score: 113782.0 |
| atari-games-on-atari-2600-crazy-climber | DQN noop | #31 | Score: 110763.0 |
| atari-games-on-atari-2600-crazy-climber | DQN hs | #34 | Score: 98128.0 |
| atari-games-on-atari-2600-demon-attack | Prior+Duel hs | #17 | Score: 73371.3 |
| atari-games-on-atari-2600-demon-attack | DDQN (tuned) hs | #21 | Score: 69803.4 |
| atari-games-on-atari-2600-demon-attack | DQN hs | #31 | Score: 12550.7 |
| atari-games-on-atari-2600-demon-attack | DQN noop | #32 | Score: 12149.4 |
| atari-games-on-atari-2600-double-dunk | DDQN (tuned) hs | #24 | Score: -0.3 |
| atari-games-on-atari-2600-double-dunk | DQN hs | #30 | Score: -6.0 |
| atari-games-on-atari-2600-double-dunk | DQN noop | #31 | Score: -6.6 |
| atari-games-on-atari-2600-double-dunk | Prior+Duel hs | #33 | Score: -10.7 |
| atari-games-on-atari-2600-enduro | Prior+Duel hs | #10 | Score: 2223.9 |
| atari-games-on-atari-2600-enduro | DDQN (tuned) hs | #22 | Score: 1216.6 |
| atari-games-on-atari-2600-enduro | DQN noop | #27 | Score: 729.0 |
| atari-games-on-atari-2600-enduro | DQN hs | #29 | Score: 626.7 |
| atari-games-on-atari-2600-fishing-derby | Prior+Duel hs | #25 | Score: 17.0 |
| atari-games-on-atari-2600-fishing-derby | DDQN (tuned) hs | #31 | Score: 3.2 |
| atari-games-on-atari-2600-fishing-derby | DQN hs | #33 | Score: -1.6 |
| atari-games-on-atari-2600-fishing-derby | DQN noop | #35 | Score: -4.9 |
| atari-games-on-atari-2600-freeway | DQN noop | #26 | Score: 30.8 |
| atari-games-on-atari-2600-freeway | DDQN (tuned) hs | #32 | Score: 28.8 |
| atari-games-on-atari-2600-freeway | Prior+Duel hs | #33 | Score: 28.2 |
| atari-games-on-atari-2600-freeway | DQN hs | #37 | Score: 26.9 |
| atari-games-on-atari-2600-frostbite | Prior+Duel hs | #16 | Score: 4038.4 |
| atari-games-on-atari-2600-frostbite | DDQN (tuned) hs | #27 | Score: 1448.1 |
| atari-games-on-atari-2600-frostbite | DQN noop | #30 | Score: 797.4 |
| atari-games-on-atari-2600-frostbite | DQN hs | #33 | Score: 496.1 |
| atari-games-on-atari-2600-gopher | Prior+Duel hs | #8 | Score: 105148.4 |
| atari-games-on-atari-2600-gopher | DDQN (tuned) hs | #24 | Score: 15253.0 |
| atari-games-on-atari-2600-gopher | DQN noop | #29 | Score: 8777.4 |
| atari-games-on-atari-2600-gopher | DQN hs | #32 | Score: 8190.4 |
| atari-games-on-atari-2600-gravitar | DQN noop | #29 | Score: 473.0 |
| atari-games-on-atari-2600-gravitar | DQN hs | #39 | Score: 298.0 |
| atari-games-on-atari-2600-gravitar | DDQN (tuned) hs | #47 | Score: 200.5 |
| atari-games-on-atari-2600-gravitar | Prior+Duel hs | #48 | Score: 167.0 |
| atari-games-on-atari-2600-hero | DQN noop | #26 | Score: 20437.8 |
| atari-games-on-atari-2600-hero | Prior+Duel hs | #29 | Score: 15459.2 |
| atari-games-on-atari-2600-hero | DQN hs | #31 | Score: 14992.9 |
| atari-games-on-atari-2600-hero | DDQN (tuned) hs | #32 | Score: 14892.5 |
| atari-games-on-atari-2600-ice-hockey | Prior+Duel hs | #14 | Score: 0.5 |
| atari-games-on-atari-2600-ice-hockey | DQN hs | #24 | Score: -1.6 |
| atari-games-on-atari-2600-ice-hockey | DQN noop | #28 | Score: -1.9 |
| atari-games-on-atari-2600-ice-hockey | DDQN (tuned) hs | #30 | Score: -2.5 |
| atari-games-on-atari-2600-james-bond | DQN noop | #25 | Score: 768.5 |
| atari-games-on-atari-2600-james-bond | DQN hs | #26 | Score: 697.5 |
| atari-games-on-atari-2600-james-bond | Prior+Duel hs | #29 | Score: 585.0 |
| atari-games-on-atari-2600-james-bond | DDQN (tuned) hs | #31 | Score: 573.0 |
| atari-games-on-atari-2600-kangaroo | DDQN (tuned) hs | #18 | Score: 11204.0 |
| atari-games-on-atari-2600-kangaroo | DQN noop | #22 | Score: 7259.0 |
| atari-games-on-atari-2600-kangaroo | DQN hs | #25 | Score: 4496.0 |
| atari-games-on-atari-2600-kangaroo | Prior+Duel hs | #37 | Score: 861.0 |
| atari-games-on-atari-2600-krull | DQN noop | #23 | Score: 8422.3 |
| atari-games-on-atari-2600-krull | Prior+Duel hs | #29 | Score: 7658.6 |
| atari-games-on-atari-2600-krull | DDQN (tuned) hs | #31 | Score: 6796.1 |
| atari-games-on-atari-2600-krull | DQN hs | #33 | Score: 6206.0 |
| atari-games-on-atari-2600-kung-fu-master | Prior+Duel hs | #20 | Score: 37484.0 |
| atari-games-on-atari-2600-kung-fu-master | DDQN (tuned) hs | #28 | Score: 30207.0 |
| atari-games-on-atari-2600-kung-fu-master | DQN noop | #31 | Score: 26059.0 |
| atari-games-on-atari-2600-kung-fu-master | DQN hs | #34 | Score: 20882.0 |
| atari-games-on-atari-2600-montezumas-revenge | DQN hs | #29 | Score: 47.0 |
| atari-games-on-atari-2600-montezumas-revenge | DDQN (tuned) hs | #30 | Score: 42.0 |
| atari-games-on-atari-2600-montezumas-revenge | Prior+Duel hs | #32 | Score: 24.0 |
| atari-games-on-atari-2600-ms-pacman | DQN noop | #22 | Score: 3085.6 |
| atari-games-on-atari-2600-ms-pacman | DDQN (tuned) hs | #35 | Score: 1241.3 |
| atari-games-on-atari-2600-ms-pacman | DQN hs | #36 | Score: 1092.3 |
| atari-games-on-atari-2600-ms-pacman | Prior+Duel hs | #37 | Score: 1007.8 |
| atari-games-on-atari-2600-name-this-game | Prior+Duel hs | #15 | Score: 13637.9 |
| atari-games-on-atari-2600-name-this-game | DDQN (tuned) hs | #29 | Score: 8960.3 |
| atari-games-on-atari-2600-name-this-game | DQN noop | #30 | Score: 8207.8 |
| atari-games-on-atari-2600-name-this-game | DQN hs | #32 | Score: 6738.8 |
| atari-games-on-atari-2600-pong | DQN noop | #28 | Score: 19.5 |
| atari-games-on-atari-2600-pong | DDQN (tuned) hs | #29 | Score: 19.1 |
| atari-games-on-atari-2600-pong | Prior+Duel hs | #33 | Score: 18.4 |
| atari-games-on-atari-2600-pong | DQN hs | #36 | Score: 18.0 |
| atari-games-on-atari-2600-private-eye | Prior+Duel hs | #19 | Score: 1277.6 |
| atari-games-on-atari-2600-private-eye | DQN hs | #28 | Score: 207.9 |
| atari-games-on-atari-2600-private-eye | DQN noop | #35 | Score: 146.7 |
| atari-games-on-atari-2600-private-eye | DDQN (tuned) hs | #47 | Score: -575.5 |
| atari-games-on-atari-2600-qbert | Prior+Duel hs | #30 | Score: 14063.0 |
| atari-games-on-atari-2600-qbert | DQN noop | #32 | Score: 13117.3 |
| atari-games-on-atari-2600-qbert | DDQN (tuned) hs | #33 | Score: 11020.8 |
| atari-games-on-atari-2600-qbert | DQN hs | #36 | Score: 9271.5 |
| atari-games-on-atari-2600-river-raid | Prior+Duel hs | #16 | Score: 16496.8 |
| atari-games-on-atari-2600-river-raid | DDQN (tuned) hs | #24 | Score: 10838.4 |
| atari-games-on-atari-2600-river-raid | DQN noop | #29 | Score: 7377.6 |
| atari-games-on-atari-2600-river-raid | DQN hs | #33 | Score: 4748.5 |
| atari-games-on-atari-2600-road-runner | Prior+Duel hs | #20 | Score: 54630.0 |
| atari-games-on-atari-2600-road-runner | DDQN (tuned) hs | #26 | Score: 43156.0 |
| atari-games-on-atari-2600-road-runner | DQN noop | #28 | Score: 39544.0 |
| atari-games-on-atari-2600-road-runner | DQN hs | #30 | Score: 35215.0 |
| atari-games-on-atari-2600-robotank | DQN noop | #15 | Score: 63.9 |
| atari-games-on-atari-2600-robotank | DDQN (tuned) hs | #21 | Score: 59.1 |
| atari-games-on-atari-2600-robotank | DQN hs | #22 | Score: 58.7 |
| atari-games-on-atari-2600-robotank | Prior+Duel hs | #30 | Score: 24.7 |
| atari-games-on-atari-2600-seaquest | DDQN (tuned) hs | #15 | Score: 14498.0 |
| atari-games-on-atari-2600-seaquest | DQN noop | #25 | Score: 5860.6 |
| atari-games-on-atari-2600-seaquest | DQN hs | #29 | Score: 4216.7 |
| atari-games-on-atari-2600-seaquest | Prior+Duel hs | #39 | Score: 1431.2 |
| atari-games-on-atari-2600-space-invaders | Prior+Duel hs | #14 | Score: 8978.0 |
| atari-games-on-atari-2600-space-invaders | DDQN (tuned) hs | #28 | Score: 2628.7 |
| atari-games-on-atari-2600-space-invaders | DQN noop | #33 | Score: 1692.3 |
| atari-games-on-atari-2600-space-invaders | DQN hs | #35 | Score: 1293.8 |
| atari-games-on-atari-2600-star-gunner | Prior+Duel hs | #11 | Score: 127073.0 |
| atari-games-on-atari-2600-star-gunner | DDQN (tuned) hs | #24 | Score: 58365.0 |
| atari-games-on-atari-2600-star-gunner | DQN noop | #27 | Score: 54282.0 |
| atari-games-on-atari-2600-star-gunner | DQN hs | #28 | Score: 52970.0 |
| atari-games-on-atari-2600-tennis | DQN noop | #10 | Score: 12.2 |
| atari-games-on-atari-2600-tennis | DQN hs | #11 | Score: 11.1 |
| atari-games-on-atari-2600-tennis | DDQN (tuned) hs | #32 | Score: -7.8 |
| atari-games-on-atari-2600-tennis | Prior+Duel hs | #36 | Score: -13.2 |
| atari-games-on-atari-2600-time-pilot | DDQN (tuned) hs | #28 | Score: 6608.0 |
| atari-games-on-atari-2600-time-pilot | Prior+Duel hs | #34 | Score: 4871.0 |
| atari-games-on-atari-2600-time-pilot | DQN noop | #35 | Score: 4870.0 |
| atari-games-on-atari-2600-time-pilot | DQN hs | #36 | Score: 4786.0 |
| atari-games-on-atari-2600-tutankham | Prior+Duel hs | #32 | Score: 108.6 |
| atari-games-on-atari-2600-tutankham | DDQN (tuned) hs | #33 | Score: 92.2 |
| atari-games-on-atari-2600-tutankham | DQN noop | #34 | Score: 68.1 |
| atari-games-on-atari-2600-tutankham | DQN hs | #37 | Score: 45.6 |
| atari-games-on-atari-2600-up-and-down | Prior+Duel hs | #26 | Score: 22681.3 |
| atari-games-on-atari-2600-up-and-down | DDQN (tuned) hs | #27 | Score: 19086.9 |
| atari-games-on-atari-2600-up-and-down | DQN noop | #33 | Score: 9989.9 |
| atari-games-on-atari-2600-up-and-down | DQN hs | #36 | Score: 8038.5 |
| atari-games-on-atari-2600-venture | DQN noop | #26 | Score: 163.0 |
| atari-games-on-atari-2600-venture | DQN hs | #27 | Score: 136.0 |
| atari-games-on-atari-2600-venture | Prior+Duel hs | #37 | Score: 29.0 |
| atari-games-on-atari-2600-venture | DDQN (tuned) hs | #40 | Score: 21.0 |
| atari-games-on-atari-2600-video-pinball | Prior+Duel hs | #18 | Score: 447408.6 |
| atari-games-on-atari-2600-video-pinball | DDQN (tuned) hs | #19 | Score: 367823.7 |
| atari-games-on-atari-2600-video-pinball | DQN noop | #25 | Score: 196760.4 |
| atari-games-on-atari-2600-video-pinball | DQN hs | #27 | Score: 154414.1 |
| atari-games-on-atari-2600-wizard-of-wor | Prior+Duel hs | #16 | Score: 10471.0 |
| atari-games-on-atari-2600-wizard-of-wor | DDQN (tuned) hs | #27 | Score: 6201.0 |
| atari-games-on-atari-2600-wizard-of-wor | DQN noop | #35 | Score: 2704.0 |
| atari-games-on-atari-2600-wizard-of-wor | DQN hs | #37 | Score: 1609.0 |
| atari-games-on-atari-2600-zaxxon | Prior+Duel hs | #20 | Score: 11320.0 |
| atari-games-on-atari-2600-zaxxon | DDQN (tuned) hs | #29 | Score: 8593.0 |
| atari-games-on-atari-2600-zaxxon | DQN noop | #32 | Score: 5363.0 |
| atari-games-on-atari-2600-zaxxon | DQN hs | #34 | Score: 4412.0 |