Limitations in acquiring training data restrict potential applications of deep reinforcement learning (RL) methods to the training of real-world robots. Here we train an RL agent to align a Mach-Zehnder interferometer, which is an essential part of many optical experiments, based on images of interference fringes acquired by a monocular camera. The agent is trained in a simulated environment, without any hand-coded features or a priori information about the physics, and subsequently transferred to a physical interferometer.

Limitations in acquiring training data restrict potential applications of deep reinforcement learning (RL) methods to the training of real-world robots.

Summary and Contributions: The paper proposed a learning system for applying deep reinforcement learning algorithms to an optical interferometer aligning task. To achieve successful learning, the authors first developed a simulation tool for simulating interferometric patterns captured by the camera, which is used to train the DRL agents using dueling ddqn. To enable the controller to transfer to the real-world system, they apply domain randomization during training. They demonstrated successful learning of an agent that can perform interferometer aligning tasks and outperforms human operators. Tha main contribution of the paper is that it demonstrates successful application to a new domain of tasks and achieves human-level performance.

Limitations in acquiring training data restrict potential applications of deep reinforcement learning (RL) methods to the training of real-world robots. Here we train an RL agent to align a Mach-Zehnder interferometer, which is an essential part of many optical experiments, based on images of interference fringes acquired by a monocular camera. The agent is trained in a simulated environment, without any hand-coded features or a priori information about the physics, and subsequently transferred to a physical interferometer.

A well executed application of deep RL to an interesting and practical problem.