Learning Sub-Second Routing Optimization in Computer Networks requires Packet-Level Dynamics