Geometry Aware Mappings for High Dimensional Sparse Factors