Go with the Flow: Optical Flow Beats Frame Stacking in RL

Interesting find: Optical flow significantly improves over just stacking frames as input to CNN for RL tasks in a dynamic environment. One can generate it using FlowNet instead of expensive computation. Even diff between two frames works as well or better: https://arxiv.org/abs/1901.03162

Discussion