Unifying 3D Representation and Control of Diverse Robots with a Single Camera