From Style to Facts: Mapping the Boundaries of Knowledge Injection with Finetuning