Leveraging Statistical Multi-Agent Online Planning with Emergent Value Function Approximation