Advancing Transformer's Capabilities in Commonsense Reasoning