SkyPilot - How can I declaratively specify port ranges on the 'serve controller' in SkyServe?

skypilot-users

How can I declaratively specify port ranges on the 'serve controller' in SkyServe?

I noticed that the examples do not specify port ranges and create a default range. Can I customize the port ranges?

Narciso

Asked on Dec 08, 2023

Currently, it doesn't support custom port ranges for the controller. The load balancing is done using a FastAPI running on your controller VM, which uses HTTP redirect to distribute traffic to replicas. However, there is an open issue https://github.com/skypilot-org/skypilot/issues/2853 to keep track of this requirement.

Dec 19, 2023Edited by