Lower bounds for trace estimation via Block Krylov and other methods