Understanding Silent Data Corruption in LLM Training