To troubleshoot why one replica is stuck in PROVISIONING, you can check the logs of the specific replica using the sky serve logs command. This can provide insights into any errors or issues that might be causing the provisioning process to stall. Additionally, you can also check for any resource limits that might have been hit, as indicated by the logs.