Learning Auto-regressive Models from Sequence and Non-sequence Data