How to tune hyper-params with fixed seeds using PyTorch Lightning and Aim
The random seed is a number that's used to initialize the pseudorandom number generator. It can have a huge impact on the training results. There are different ways that the pseudorandom number generator can be used in ML. As you can see, the random seed can have an influence on the result of training in several ways and add a huge variance. One thing you do not need when tuning hyper-parameters is variance.
Mar-11-2021, 14:35:14 GMT
- Technology: