The One Obstacle to Intelligent AI

Earlier this month I was figuring out how to code a recurrent neural network (RNN, a common form of neural networks for text generation) to rewrite its own code. The idea was to train the RNN to completion, then to take code it generated (with syntax checks, of course) and run it. The code that the RNN generated would serve the purpose of generating more code to generate more RNNs, and so on, with each new'generation' of RNN coding the next. I was incredibly excited to see how it would turn out --the idea is exciting to entertain. An AI trained to improve itself will inevitably do so, right?