Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning