When 90% Less is More: Sturgeon's Law in AI
There is something profound about Sturgeon’s law. It not only applies to research papers, books, videos etc but also things like Lottery Ticket Hypothesis, model pruning etc. Pruning ~90% of the parameters in a model have little impact on performance.