CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency
Wu, Hongyan, Zeng, Peijian, Zheng, Weixiong, Wang, Lianxi, Lin, Nankai, Jiang, Shengyi, Yang, Aimin
–arXiv.org Artificial Intelligence
Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the learning states at different training stages and enhancing training efficiency. To tackle these challenges, this paper proposes a Curriculum Learning-bAsed croSS-modal text-molecule training framework (CLASS), which can be integrated with any backbone to yield promising performance improvement. Specifically, we quantify the sample difficulty considering both text modality and molecule modality, and design a sample scheduler to introduce training samples via an easy-to-difficult paradigm as the training advances, remarkably reducing the scale of training samples at the early stage of training and improving training efficiency. Moreover, we introduce adaptive intensity learning to increase the training intensity as the training progresses, which adaptively controls the learning intensity across all curriculum stages. Experimental results on the ChEBI-20 dataset demonstrate that our proposed method gains superior performance, simultaneously achieving prominent time savings.
arXiv.org Artificial Intelligence
Feb-17-2025
- Country:
- Asia
- China > Guangdong Province
- Guangzhou (0.04)
- Middle East > UAE
- Abu Dhabi Emirate > Abu Dhabi (0.04)
- China > Guangdong Province
- North America
- Canada > Ontario
- Toronto (0.04)
- Dominican Republic (0.04)
- United States
- California > San Diego County
- San Diego (0.04)
- New York > New York County
- New York City (0.04)
- California > San Diego County
- Canada > Ontario
- Asia
- Genre:
- Research Report > New Finding (0.46)
- Technology: