Gradient descent with adaptive stepsize converges (nearly) linearly under fourth-order growth