Learning long-term dependencies is not as difficult with NARX networks

Lin, Tsungnan, Horne, Bill G., Tiño, Peter, Giles, C. Lee

Dec-31-1996–Neural Information Processing Systems 

However, learning simple behavior can be quite "Also with NEC Research Institute.