Exploring zero-shot structure-based protein fitness prediction