Optimization on Manifolds via Graph Gaussian Processes