Adapting to Fragmented and Evolving Data: A Fisher Information Perspective