Learning Polynomial Problems with $SL(2,\mathbb{R})$ Equivariance