Physics-Informed Optical Kernel Regression Using Complex-valued Neural Fields