Ray Train¶
Distributed training with Torch, LightGBM and XGBoost. The trainer type is a setting of the Trainer node that the canvas does not draw, so the graphs for 36, 37 and 38 look the same.
This section holds 4 notebooks from ray_patterns/train/ in the ganymede repository. Each page shows the notebook as committed; use the buttons at the top right of a page to download the .ipynb or open it on GitHub.
Notebooks¶
- Ray Train: TorchTrainer over a dataset: A TorchTrainer runs a training loop on one CPU worker and reads its shard of a Ray Dataset.
- Ray Train: LightGBMTrainer: A LightGBMTrainer runs a gradient-boosted tree training loop on a Ray Dataset shard.
- Ray Train: XGBoostTrainer: An XGBoostTrainer runs a gradient-boosted tree training loop on a Ray Dataset shard.
- Ray Train: validation data, run config and results: Two workers train with a train and a validation dataset, a train_loop_config dict and a RunConfig; result nodes pull the final metrics and the run directory…