Loki: Low-Rank Keys for Efficient Sparse Attention