The purpose of article is to show the steps I took to get the gym-pybullet-drones environment to run on Windows using Docker. The environment is not officially supported although the repository README as tips for running on Windows, this can be alternate way to get it running with a lot of the headaches. The gym-pybullet-drones is a great environment for testing out Reinforcement Learning algorithms on drones. Running the environment in a workspace has the benefit of creating a workspace for that is portable to all platforms. First thing first, Install Docker and configure it to use WSL 2 as a backend.

Here are Dockerfiles to get you up and running with a fully functional deep learning machine. It contains all the popular deep learning frameworks with CPU and GPU support (CUDA and cuDNN included). The CPU version should work on Linux, Windows and OS X. If you are not familiar with Docker, but would still like an all-in-one solution, start here: What is Docker?. GPU Version Only: Install Nvidia drivers on your machine either from Nvidia directly or follow the instructions here. Note that you don't have to install CUDA or cuDNN.