Can Transformers Reason in Fragments of Natural Language?