Hyperparameter optimization of data-driven AI models on HPC systems