Training Flexible Models of Genetic Variant Effects from Functional Annotations using Accelerated Linear Algebra