Foundation Model's Embedded Representations May Detect Distribution Shift