How many views does your deep neural network use for prediction?