Adaptation Odyssey in LLMs: Why Does Additional Pretraining Sometimes Fail to Improve?