Generalization Through Growth: Hidden Dynamics Controls Depth Dependence