On the Challenges of Physical Implementations of RBMs