PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks