I'm trying to run the hello-skyserve
tutorial on Kubernetes, but I'm getting an error. I'm wondering if serving a model on Kubernetes is supported.
Cyrille
Asked on Jan 23, 2024
Yes, it is possible to sky serve
on Kubernetes. The team has merged a PR to support open ports on Kubernetes, but there are still some minor changes needed to make it compatible with SkyServe.