Even if we overcome the integration issues, we are still faced with challenges defining the overlap term. Existing evaluation methods in previous works do not directly measure reward. These evaluation methods primarily focus on not changing agent's original actions under adversarial When most actions don't change under attack, the reward is also In addition a full description of A WC is provided in Algorithm 2.Algorithm 2: Absolute Worst-Case RewardS SA-DQN requires this to be 1 - this can cause issues when the natural Q-values differ by less than 1. We tested this new loss on BankHeist and RoadRunner for Atari. Full results are summarized in below Table 4.