GeoRecon: Graph-Level Representation Learning for 3D Molecules via Reconstruction-Based Pretraining
Yan, Shaoheng, Li, Zian, Zhang, Muhan
–arXiv.org Artificial Intelligence
The pretraining-finetuning paradigm has powered major advances in domains such as natural language processing and computer vision, with representative examples including masked language modeling and next-token prediction. In molecular representation learning, however, pretraining tasks remain largely restricted to node-level denois-ing, which effectively captures local atomic environments but is often insufficient for encoding the global molecular structure critical to graph-level property prediction tasks such as energy estimation and molecular regression. To address this gap, we introduce Geo-Recon, a graph-level pretraining framework that shifts the focus from individual atoms to the molecule as an integrated whole. GeoRe-con formulates a graph-level reconstruction task: during pretraining, the model is trained to produce an informative graph representation that guides geometry reconstruction while inducing smoother and more transferable latent spaces. This encourages the learning of coherent, global structural features beyond isolated atomic details. Without relying on external supervision, GeoRecon achieves generally improves over backbones baselines on multiple molecular benchmarks including QM9, MD17, MD22, and 3BPA, demonstrating the effectiveness of graph-level reconstruction for holistic and geometry-aware molecular embeddings.
arXiv.org Artificial Intelligence
Oct-21-2025
- Genre:
- Research Report > New Finding (1.00)
- Industry:
- Materials > Chemicals > Commodity Chemicals > Petrochemicals (0.46)
- Technology: