Kernel selection plays a central role in determining the performance of Gaussian Process (GP) models, as the chosen kernel determines both the inductive biases and prior support of functions under the GP prior. This work addresses the challenge of constructing custom kernel functions for high-dimensional GP regression models. Drawing inspiration from recent progress in deep learning, we introduce a novel approach named KITT: Kernel Identification Through Transformers. KITT exploits a transformer-based architecture to generate kernel recommendations in under 0.1 seconds, which is several orders of magnitude faster than conventional kernel search algorithms. We train our model using synthetic data generated from priors over a vocabulary of known kernels. By exploiting the nature of the selfattention mechanism, KITT is able to process datasets with inputs of arbitrary dimension. We demonstrate that kernels chosen by KITT yield strong performance over a diverse collection of regression benchmarks.

When Pam Cronrath's husband Bill died last year, after nearly 60 years of marriage, she knew what she wanted to do, but not exactly how. I promised him a super wake, she told the BBC. What she didn't expect was that keeping the promise would lead her into the world of holograms, technology more commonly associated with celebrities than memorial services in rural America. A self-confessed tech enthusiast, she says her outlook was shaped by a career that stretched back to the early days of the internet. Several years ago, while speaking at a medical conference, she watched a doctor appear as a full-body hologram broadcast live across the United States.