Tight Rates for Bandit Control Beyond Quadratics