skypilot-users

Recommendations for hyperparameter tuning setup with skypilot?

Al

Alex Kouzemtchenko

Asked on Nov 02, 2023

Yes, you can use Ray Tune and have each trial call into SkyPilot's CLI sky spot launch or Python API. There are a few patterns you can follow:

  • Launch 1 cluster and execute all trials on the cluster.
  • Have each trial occupy its own cluster by using a control loop calling sky launch or sky spot launch for each trial.

The control loop can be implemented using a bash script, a simple Python script, or an HPO framework like Ray Tune.

Nov 02, 2023Edited by