Towards Flexible Inference in Sequential Decision Problems via Bidirectional Transformers