Loki: Low-rank Keys for Efficient Sparse Attention