Deep Trouble: Deeper Layers Don't See the Big Picture
Very cool and important work! Long held and widely accepted view (especially since Zeiler el al) that deeper layers recognizes larger overall shapes and relationships- now completely goes in to the drain. For a through shock see fig 5 in paper and also https://blog.usejournal.com/why-deep-learning-works-differently-than-we-thought-ec28823bdbc https://x.com/wielandbr/status/1093175710078943233