Neural Integral Operators for Inverse problems in Spectroscopy