Learning Grammar of Complex Activities via Deep Neural Networks