Ponging to Perfection: Max Score Achieved in 1.5 Hours
Replicating few results… Some stats for Atari Pong using OpenAI baselines on Azure NV6 VM (M60 GPU): about 1M frames, 1.5hr, 650 episodes (each ~1500 steps, 8sec) to hit max score of 21 for the first time.