Parameter-Efficient Conditioning for Material Generalization in Graph-Based Simulators