framework: 1) makes a very novel and thought-provoking [ R3 ] connection between RNN and optimization [ R3

Below we address the concerns raised by the reviewers. We believe there is a misunderstanding. LSTM, the cell state performs additive integration of the input so that the gradients do not vanish. " We hope reviewers can reevaluate this crucial point. Rather, we aim to bring in new ideas from optimization to design better RNNs.