Memory-based Controllers for Efficient Data-driven Control of Soft Robots