Advancing Robot Autonomy for Long-Horizon Tasks