SkyPilot

// Overview

SkyPilot is a system for running, managing, and scaling AI workloads across any compute you have access to. You describe a job once in a small YAML file, and SkyPilot provisions the resources, syncs your code, runs the job, and cleans up idle machines when it finishes.

It is built for AI teams who want a single way to launch jobs without hand-managing each cloud, and for infra teams who want one control plane over Kubernetes, Slurm, reserved GPUs, and more than 20 cloud providers. Your existing GPU, TPU, and CPU jobs run with no code changes.

Within compute orchestration, SkyPilot sits above individual schedulers and cloud APIs. It handles GPU/TPU/CPU provisioning with smart failover across providers, queues and auto-recovers jobs, and runs everything inside your own cloud accounts and clusters (BYOC).

// What it does

• One interface to run jobs on Kubernetes, Slurm, reserved GPUs, or 20+ clouds including AWS, GCP, Azure, OCI, Lambda, RunPod, and Nebius
• Flexible provisioning of GPUs, TPUs, and CPUs with automatic failover to available, cheaper infrastructure
• Autostop and binpacking to clean up idle resources and pack workloads onto shared clusters
• Job queueing, multi-node and gang scheduling, and automatic recovery of failed jobs
• Local-style development on Kubernetes: SSH into pods, sync code, or connect your IDE
• BYOC design: clusters launch inside your own cloud accounts, VPCs, and Kubernetes clusters

// Getting started

Install SkyPilot with the cloud and Kubernetes backends you need, then launch your first cluster from a short task YAML.

uv pip install "skypilot[kubernetes,aws,gcp,azure,oci,nebius,lambda,runpod,fluidstack,paperspace,cudo,ibm,scp,seeweb,shadeform,verda]"

resources:
  infra: k8s/coreweave
  accelerators: B200:8

workdir: .

setup: |
  uv pip install torch

run: |
  echo "Hello, SkyPilot!"
  nvidia-smi

sky launch -c mycluster hello_sky.yaml
sky status

Commands and code are distilled from the project's own documentation — always check the official repo for the latest.

// When to use it

• Running model training or fine-tuning jobs on whichever cloud has the cheapest available GPUs
• Giving an infra team one control plane over multiple Kubernetes and Slurm clusters
• Queueing and auto-recovering many batch jobs across a shared GPU fleet
• Spinning up an interactive dev environment on Kubernetes with code sync and IDE access

// How SkyPilot compares

SkyPilot alongside other open-source gpu & compute clouds tools AI/TLDR tracks, ranked by GitHub stars.