Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks