Question understanding batched training with RNNs • /r/MachineLearning
Hi! I'm working on a character-level LSTM right now for learning purposes; I've written my code to handle batches of data but for now I've trained my LSTM by just reading in one stream of input as with karpathy's mini char-rnn. The more I read, the more I feel that I should do a batched approach rather than one stream of character inputs. Only problem is, I guess I don't entirely understand how to train it in a batched form. Is the idea that I train my RNN the same way but send in as my input matrix of these 150 characters at 25 quotes a piece? Will I ultimately be training it on ALL 10,000 quotes or just a random subset?
Jun-7-2016, 16:46:06 GMT
- Technology: