Spectrally Informed Learning of Fluid Flows