I'm trying to provision the Vicuna model following the Sky serve tutorial, but it has been running for about an hour and a half. I have successfully run the 'Hello, SkyServe!' example. Any idea how long it usually takes to provision the model?
David Tran
Asked on Dec 29, 2023
The provisioning time for the Vicuna model can vary depending on various factors such as the availability of resources and the chosen accelerator. However, it is not uncommon for the provisioning process to take more than an hour. If the provisioning process is taking longer than expected, it is recommended to check the logs for any errors or issues. Additionally, it may be worth considering using a different accelerator, such as V100 or spot A100, if the OnDemand A100 is scarce.
