Just-in-Time Hierarchical Constraint Decomposition