Diversify, Contextualize, and Adapt: Efficient Entropy Modeling for Neural Image Codec