FlashBack:Efficient Retrieval-Augmented Language Modeling for Long Context Inference