Exploring and Reshaping the Weight Distribution in LLM