Is Long Horizon RL More Difficult Than Short Horizon RL?