Structure Matters: Dynamic Policy Gradient