Goto

Collaborating Authors

 batched training


Question understanding batched training with RNNs • /r/MachineLearning

@machinelearnbot

Hi! I'm working on a character-level LSTM right now for learning purposes; I've written my code to handle batches of data but for now I've trained my LSTM by just reading in one stream of input as with karpathy's mini char-rnn. The more I read, the more I feel that I should do a batched approach rather than one stream of character inputs. Only problem is, I guess I don't entirely understand how to train it in a batched form. Suppose I have 10,000 quotes (for train, not validation) of maximum 150 characters and batch_size 25. Is the idea that I train my RNN the same way but send in as my input matrix of these 150 characters at 25 quotes a piece?