Many classic methods have shown non-local self-similarity in natural images to be an effective prior for image restoration. However, it remains unclear and challenging to make use of this intrinsic property via deep networks.

Neural Information Processing Systems http://nips.cc/

Since deep neural networks (DNNs) became successful, domain adaptation methods also leveraged them for representation learning.

Neural Information Processing Systems http://nips.cc/

We propose ChatCam, a system that allows users to control camera operations through natural language interaction.

Neural Information Processing Systems http://nips.cc/

Moreover, our 1B model achieves exceptional performance, surpassing GPT -3.5-Turbo and Claude-3 Haiku.

Neural Information Processing Systems http://nips.cc/

However, in practice, new reconstruction methods could improve performance for at least three other reasons: learning more about the distribution of stimuli, becoming better at reconstructing text or images in general, or exploiting weaknesses in current image and/or text evaluation metrics. Here we disentangle how much of the reconstruction is due to these other factors vs. productively using the neural recordings.