A model of sensory neural responses in the presence of unknown modulatory inputs