Doubly-Asynchronous Value Iteration: Making Value Iteration Asynchronous in Actions

However, Asynchronous VI still requires a maximization over the entire action space, making it impractical for domains with large action space.