I'm failing to acquire a spot node with accelerator type H100 with GCP cloud configured while I can provision it through GCE directly.
Rick Lamers
Asked on Feb 19, 2024
Yes, currently SkyServe replicas do not support H100 spot nodes in the GCP catalog. This limitation has been acknowledged and an issue has been raised on GitHub to address this. In the meantime, you can provision H100 spot nodes through GCE directly.
