Combining CNNs and RNNs – Crazy or Genius?

Summary: There are some interesting use cases where combining CNNs and RNN/LSTMs seems to make sense and a number of researchers pursuing this. However, the latest trends in CNNs may make this obsolete. There are things that just don't seem to go together. Take oil and water for instance. Both valuable, but try putting them together?