skypilot-users
How to troubleshoot GCS file mount issues when running on a different provider?
I'm facing difficulties with GCS file mount when running on a different provider. The file mount configuration is not working as expected, and the mounted directory appears empty after provisioning. I've tried using mode: MOUNT but encountered issues. mode: COPY works fine. How can I troubleshoot and resolve this issue?
As
Ash
Asked on Mar 28, 2024
-
Check the cloud provider's support for mounting object stores:
- Some cloud providers may not support mounting object stores like GCS without
privilegedmode.
- Some cloud providers may not support mounting object stores like GCS without
-
Use
COPYmode as an alternative:- Manually upload files at the end of the task using
gsutil cp.
- Manually upload files at the end of the task using
-
Consider the following workaround:
resources: cloud: runpod ... file_mounts: /data: source: gs://<bucket-name> mode: MOUNT run: | echo hi > mycheckpoint.dat gsutil cp mycheckpoint.dat gs://mybucket/ -
Future improvements:
- Fail early if mounting is not supported on a cloud provider.
- Provide clear error messages when mounting fails.
- Track progress on related issue: https://github.com/skypilot-org/skypilot/issues/1895
Mar 28, 2024Edited by