Desynchronous Learning in a Physics-Driven Learning Network