SparseGrow: Addressing Growth-Induced Forgetting in Task-Agnostic Continual Learning