█

AI/TLDR

Buy me a coffee
Buy me a coffee

Polyaxon

Track, schedule, and scale deep learning experiments on Kubernetes

Experiment TrackingOpen source
Language
Python
IN SHORT

What is Polyaxon?

Polyaxon is an open-source platform for building, training, and monitoring deep learning applications at scale. It runs on Kubernetes and deploys into any data center, cloud provider, or a hosted managed service, supporting major frameworks such as TensorFlow, MXNet, Caffe, and Torch. It sits in the Experiment Tracking category of the Training & Fine-Tuning tools and is open-source, written in Python.

Overview

Polyaxon is an open-source platform for building, training, and monitoring deep learning applications at scale. It runs on Kubernetes and deploys into any data center, cloud provider, or a hosted managed service, supporting major frameworks such as TensorFlow, MXNet, Caffe, and Torch.

It is aimed at data science and ML teams that need to track experiments, schedule jobs, and share GPU servers as self-service resources. Polyaxon manages workloads through container and node management, so a team can reproduce runs and keep results organized as the number of experiments grows.

As an experiment-tracking and MLOps tool, Polyaxon covers the full loop: a CLI to run and track experiments, a dashboard to browse projects and runs, plus built-in support for distributed jobs, parallel execution, hyperparameter tuning, and DAG-based pipelines.

What it does

  • Tracks logs and resource usage for experiments, with reproducible runs across teams
  • Runs on Kubernetes and deploys to any data center, cloud provider, or Polyaxon's hosted service
  • Supports major deep learning frameworks including TensorFlow, MXNet, Caffe, and Torch
  • Distributed training support for TensorFlow, PyTorch, MPI, Horovod, Spark, and Dask
  • Hyperparameter tuning with grid search, random search, Hyperband, Bayesian optimization, and Hyperopt
  • DAG flow engine for running container-native ML pipelines with dependencies between operations

Getting started

Install the CLI with pip, deploy Polyaxon onto a Kubernetes cluster, then create a project and run your first experiment.

Install the CLI

Install the Polyaxon command-line interface with pip.

bashbash
# Install Polyaxon CLI
pip install -U polyaxon

Deploy to Kubernetes

Create a namespace, add the Helm charts repo, deploy Polyaxon from a config file, and forward the API port.

bashbash
# Create a namespace
kubectl create namespace polyaxon

# Add Polyaxon charts repo
helm repo add polyaxon https://charts.polyaxon.com

# Deploy Polyaxon
polyaxon admin deploy -f config.yaml

# Access API
polyaxon port-forward

Create a project and run an experiment

Create a project, then upload your code and start an experiment while tracking logs and resources.

bashbash
# Create a project
polyaxon project create --name=quick-start --description='Polyaxon quick start.'

# Upload code and start experiments
polyaxon run -f experiment.yaml -u -l

Open the dashboard

Launch the Polyaxon dashboard to browse your projects and experiments.

bashbash
polyaxon dashboard -y

Commands and code are distilled from the project's own documentation — always check the official repo for the latest.

When to use it

  • Teams sharing GPU servers who need to schedule and queue training jobs as self-service resources
  • Tracking experiment logs, metrics, and resource usage to keep deep learning runs reproducible
  • Running hyperparameter searches such as grid, random, Hyperband, or Bayesian optimization at scale
  • Orchestrating multi-step ML pipelines and distributed training jobs on Kubernetes via DAGs

How Polyaxon compares

Polyaxon alongside other open-source experiment tracking tools AI/TLDR tracks, ranked by GitHub stars.

ToolStarsWhat it does
MLflow★ 28.9kAn open-source ML and GenAI platform that, alongside experiment tracking, provides evaluation and monitoring tools for scoring and comparing LLM and agent outputs.
DVC★ 16kA Git-like version control tool for datasets, models, and experiments that makes ML projects reproducible.
Weights & Biases (wandb)★ 11.3kAn open-source client library for logging experiments, running hyperparameter sweeps, and versioning models and datasets.
ClearML★ 6.9kAn open-source MLOps suite whose experiment manager auto-logs runs, metrics, and artifacts and ties them into data management and orchestration.
Aim★ 6.3kA self-hosted, open-source experiment tracker that logs and compares thousands of training runs through a fast web UI.
Sacred★ 4.4kA Python tool for configuring, organizing, logging, and reproducing computational research experiments.
Polyaxon★ 3.7kTrack, schedule, and scale deep learning experiments on Kubernetes
Trackio★ 1.8kA lightweight open-source experiment tracker from Hugging Face that stores runs locally in SQLite as a drop-in alternative to wandb.