Simple is what you need for efficient and accurate medical image segmentation