DIAMANT: Dual Image-Attention Map Encoders For Medical Image Segmentation