Ray Tune¶
Hyperparameter search, schedulers and stoppers.
This section holds 3 notebooks from ray_patterns/tune/ in the ganymede repository. Each page shows the notebook as committed; use the buttons at the top right of a page to download the .ipynb or open it on GitHub.
Notebooks¶
- Ray Tune: grid search with ASHA early stopping: A Tuner sweeps the learning rate of a TorchTrainer over a grid, and the ASHA scheduler stops weak trials early.
- Ray Tune: Optuna search: The same trainer tuned with OptunaSearch sampling the learning rate from a uniform range.
- Ray Tune: median stopping, a stopper and the ResultGrid: Two grid trials under the median stopping rule and a MaximumIteration stopper; ResultGrid nodes pull a DataFrame of trial results and the error count.