Falcon: FastSpectralInferenceonEncryptedData