Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent