Hamza Tahir
Asked on Nov 27, 2023
Yes, skypilot now supports running DAGs using spot pipelines. You can use the spot launch
command on a sequential chain of tasks. The topography of the tasks can be controlled by writing them in the desired order in the YAML file. Additionally, you can write logic to launch tasks on the cluster and control the topography by waiting for task completion or creating an orchestrator task that launches other tasks within the cluster.