Theano GPU vs pure Numpy (CPU) -

In this benchmark, I've used a Windows 10 Pro 64 Bit computer with Intel Core i7 6700HQ 2.60 GHz with 32 Gb RAM and NVIDIA GeForce GTX 960M. As a programming environment, I've used Python 2.7 (Anaconda distribution) and Jupyter. The code I've written is this (without matplotlib functions and float32 numbers, in order to use the GPU): So, Numpy is on average 300% slower than Theano (with GPU support). The spikes should be due to CPU overload, multitasking or memory swapping. However, it's absolutely clear that Theano (I'm going to test also Tensorflow) should be the best choice if you want to implement deep learning algorithms (in particular if you have a good GPU).