Balancing Speed and Stability: The Trade-offs of FP8 vs. BF16 Training in LLMs