A Machine Learning approach for correcting radial velocities using physical observables