A Environment Details DeepMind control suite. DMControl Suite [

Visualized observations are shown in the Setting column of Table 1 ( Bottom). The visualizations of the environment are shown in Figure 4a. In this section, we provide PIE-G's detailed settings. As shown in Table 8, we set up our hyper-parmeters and environmental details in three benchmarks. For the Drawer World task, we use a small learning rate in order to maintain the training stability.