Tests for model misspecification in simulation-based inference: from local distortions to global model checks