Neural Sculpting: Uncovering hierarchically modular task structure in neural networks through pruning and network analysis

The high-level question in this work is: If we learn a task using a sufficiently deep NN, how can we uncover the underlying hierarchical organization of sub-functions in that task?