[D] Applying OpenAI Baselines to anything other than Atari Games possible? • r/MachineLearning

This is a genuine question! If you look into the code, you'll find they are calling properties on the observation space variables that are passed into the learners that don't exist. I am trying to do policysearch with a dict based observationspace. Nothing suggests that wouldn't be possible. None, None) # None for shape and dtype, since it'll require special handling so ... rewriting the code to be a tuple now.