Statistical Learning
Appendix for Softmax Deep Double Deterministic Policy Gradients Ling Pan
We demonstrate the smoothing effect of SD3 on the optimization landscape in this section, where experimental setup is the same as in Section 4.1 in the text for the comparative study of SD2 and Experimental details can be found in Section B.2. The performance comparison of SD3 and TD3 is shown in Figure 1(a), where SD3 significantly outperforms TD3. So far, we have demonstrated the smoothing effect of SD3 over TD3. Hyperparameters of DDPG and SD2 are summarized in Table 1. Assume that the actor is a local maximizer with respect to the critic.
ExactPrivacyGuaranteesforMarkovChain ImplementationsoftheExponentialMechanismwith ArtificialAtoms
Existing work has examined these effects asymptotically, but implementable finite sample results are needed in practice so that users can specify privacy budgets in advance and implement samplers with exact privacy guarantees.
Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictors
Code is available at this repository: https://github.com/thuml/Koopa.
