My favorite post in a while, look forward to seeing more. I actually have a question for you (or anyone else who reads this) I have some experience with Box2D and other stuff OpenAI/Gym uses and I'd love to create some games/sims that people could train there AI's for, is there a good guide line I could use when making these?

You've probably heard about OpenAI -- a new nonprofit to focus on artificial intelligence research that is good for humanity. So here we have a case of knowledgeable people recognizing a threat and deciding that the way forward is to create a nonprofit organization. This moment has some historical precedent. In 1955, Albert Einstein, Bertrand Russell and several other scientists got together and issued a manifesto about the dangers of nuclear technologies. It would launch decades of Pugwash conferences and the anti-nuclear movement. The founders of OpenAI also issued a manifesto.

Gym-TORCS is the reinforcement learning (RL) environment in TORCS domain with OpenAI-gym-like interface. TORCS is the open-rource realistic car racing simulator recently used as RL benchmark task in several AI studies. Gym-TORCS is the python wrapper of TORCS for RL experiment with the simple interface (similar, but not fully) compatible with OpenAI-gym environments. The current implementaion is for only the single-track race in practie mode. If you want to use multiple tracks or other racing mode (quick race etc.), you may need to modify the environment, "autostart.sh" or the race configuration file using GUI of TORCS.

"Because of AI's surprising history, it's hard to predict when human-level AI might come within reach," the group, OpenAI, said in a statement on their website. "When it does, it'll be important to have a leading research institution which can prioritise a good outcome for all over its own self-interest." The project is a non-profit effort and their main objective is to save humanity, not generate income. "OpenAI is a non-profit artificial intelligence research company. Our goal is to advance digital intelligence in the way that is most likely to benefit humanity as a whole, unconstrained by a need to generate financial return," the OpenAI website explains.

Humans have an impressive ability to reason about new concepts and experiences from just a single example. In particular, humans have an ability for one-shot generalization: an ability to encounter a new concept, understand its structure, and then be able to generate compelling alternative variations of the concept. We develop machine learning systems with this important capacity by developing new deep generative models, models that combine the representational power of deep learning with the inferential power of Bayesian reasoning. We develop a class of sequential generative models that are built on the principles of feedback and attention. These two characteristics lead to generative models that are among the state-of-the art in density estimation and image generation. We demonstrate the one-shot generalization ability of our models using three tasks: unconditional sampling, generating new exemplars of a given concept, and generating new exemplars of a family of concepts. In all cases our models are able to generate compelling and diverse samples---having seen new examples just once---providing an important class of general-purpose models for one-shot machine learning.

OpenAI Gym is a toolkit for developing and comparing reinforcement learning algorithms. It makes no assumptions about the structure of your agent, and is compatible with any numerical computation library, such as TensorFlow or Theano. You can use it from Python code, and soon from other languages. To get started, you'll need to have Python 2.7 or Python 3.5. You can later run pip install -e .[all] to do a full install (this requires cmake and a recent pip version).

As a taxi driver, you need to pick up and drop off passengers as fast as possible.

That was actually a quite nice overview for beginners. Also, I have no clue why your speaking style reminds me of hack the planet.

Right on cue, this past week heralded in an announcement of OpenAI, a new non-profit started by a number of tech luminaries to spearhead AI research that is publicly accessible. The motivation is that apparently these scions of capitalism lose faith in Adam Smith's invisible hand when it comes to AI R&D. Musk continues to promote the idea that AI will be humanity's largest existential threat. Challenging this view, the HBR asks if "OpenAI [is] Solving the Wrong Problem", pointing to the implied lack of trust in capitalism. This is similar to my own parry: that the biggest existential threat to humanity is humanity.

OpenAI Gym is a toolkit for developing and comparing reinforcement learning algorithms. This is the gym open-source library, which gives you access to an ever-growing variety of environments. You can use it from Python code, and soon from other languages. If you're not sure where to start, we recommend beginning with the docs on our site. There are two basic concepts in reinforcement learning: the environment (namely, the outside world) and the agent (namely, the algorithm you are writing).