A False Sense of Safety: Unsafe Information Leakage in 'Safe' AI Responses