Improving action classification with brain-inspired deep networks