SALMAN: Stability Analysis of Language Models Through the Maps Between Graph-based Manifolds