skypilot-users
How can I speed up the initialization time for Skypilot Runtime and Skypilot dependencies?
The user is looking for ways to reduce the initialization time for Skypilot Runtime and Skypilot dependencies, which currently takes around 30-40% of the total launch time. They have explored pre-building AMIs with fixed versions of ray and Skypilot, and also switched to building off Docker images. The user found that installing Ray in the Docker image and configuring Conda helped reduce the initialization time to around 1 minute from 3 minutes.
Mo
Moin Nadeem
Asked on Mar 18, 2024
- Uploading the local machine's SkyPilot wheel to the cluster and running
pip install ray[default] skypilot<wheel>on the cluster are the main steps causing the delay. - One workaround is to pre-build AMIs or Docker images with fixed versions of Ray and Skypilot installed to reduce the initialization time.
- By switching to building off Docker images and installing Ray in the image while configuring Conda correctly, the user was able to lower the initialization time to around 1 minute from 3 minutes.
Mar 19, 2024Edited by