Augment-Connect-Explore: a Paradigm for Visual Action Planning with Data Scarcity