Neural Routing by Memory