There is HOPE to Avoid HiPPOs for Long-memory State Space Models