POTTER: Pooling Attention Transformer for Efficient Human Mesh Recovery