Bidirectional Hierarchical Protein Multi-Modal Representation Learning