A Theoretical View on Sparsely Activated Networks