Characterizing Coherent Integrated Photonic Neural Networks under Imperfections