skypilot-users

Is it possible to `sky serve` on Kubernetes?

I'm trying to run the hello-skyserve tutorial on Kubernetes, but I'm getting an error. I'm wondering if serving a model on Kubernetes is supported.

Cy

Cyrille

Asked on Jan 23, 2024

Yes, it is possible to sky serve on Kubernetes. The team has merged a PR to support open ports on Kubernetes, but there are still some minor changes needed to make it compatible with SkyServe.

Jan 23, 2024Edited by