Foundation Visual Encoders Are Secretly Few-Shot Anomaly Detectors