SkyPilot - Which Cloud Providers Integrate Best with SkyPilot for Single-User LLM Inference?

skypilot-users

Which Cloud Providers Integrate Best with SkyPilot for Single-User LLM Inference?

I'm exploring SkyPilot for my single-user LLM inference needs and am curious about which cloud providers offer the best integration with SkyPilot. I've previously used RunPod but encountered some limitations. I'm open to switching to a cloud provider that has better support with SkyPilot. Can you recommend the most well-supported cloud providers for this use case?

Ma

Malcolm Sharpe

Asked on Mar 08, 2024

Hi there! If you're looking for cloud providers that integrate well with SkyPilot, especially for production use, I'd recommend AWS and GCP. They are the most production-tested with SkyPilot. However, we're always working on improvements, so if you encounter any issues, please let us know. In terms of setup time, trying out AWS or GCP with setup commands might be beneficial. For development machines, consider stopping and restarting instead of launching anew, as restarting tends to be faster.

Mar 09, 2024Edited by