Does Tensorflow simply graphs? • r/MachineLearning

The main reason this is not yet in most frameworks (except Theano) is that all frameworks are fighting for fan/customer base and all they care about is present benchmarks and nice tutorials. If you look at the recently published benchmark of a.k.a. "The response of Tensorflow on Caffee2" you will notice that the code written does not look anything like what any normal person outside the TF team would write. This kind of optimisations do exist in Theano as well as much more, and with XLA they will potentially slowly be added to Tf. On the second point, yes that violates that rule, but in the ML who cares for software engineering (pun intended). In fact, my personal dream is to have a Mathematical IR which represents only the maths, without any knowledge of the framework/hardware - purely mathematical formulation.