Does Deep Learning always have to Reinvent the Wheel?