Hyperparameter Tuning

#aws #sagemaker #hyperparamter tuning

It learns in the process, so it does not run all possible combinations.

  • Don’t optimize many hyperparameters all at once.
  • Small ranges + logarithmic scale
  • Small batches for it to learn