Overview
Agents CLI (`agents-cli`) is Google's command-line tool for the lifecycle of an agent built on the Agent Development Kit: scaffold a project, run it, evaluate it, deploy it to Google Cloud, register it with Gemini Enterprise, and observe it in production. It is explicitly not a coding agent and not a replacement for ADK — ADK is the framework you write the agent in, and `agents-cli` is the tooling around it.
Its second half is the part that distinguishes it. `agents-cli setup` installs a set of agent skills into whatever coding assistant you already use — Antigravity CLI, Claude Code, Codex, or another — so that assistant knows the ADK Python API, the scaffolding commands, the evaluation methodology, the deployment targets and the observability wiring without you having to teach it. Seven skills cover workflow, ADK code, scaffolding, eval, deploy, publish and observability. The CLI also works standalone: every command runs directly from a terminal, and the skills are a convenience layer, not a requirement.
Evaluation is unusually well covered for a scaffolding tool. Beyond `eval run`, the CLI can synthesise multi-turn eval scenarios for a local agent, grade generated traces against named metrics, compare two result files, cluster failure modes out of grade results, and auto-tune agent prompts from the eval data. Local development — `create`, `run`, `eval` — works against an AI Studio API key without a Google Cloud project; Cloud is needed for deployment and the platform features. The project is Apache-2.0 licensed and published to PyPI as `google-agents-cli`. It is the successor to Agent Starter Pack, which moved to maintenance mode and points new projects here.
What it does
- Project scaffolding with `create`, plus `scaffold enhance` to add deployment and CI/CD to an agent project that already exists
- Evaluation suite: run and grade traces, synthesise multi-turn eval scenarios, compare two result files, cluster failure modes, and auto-tune prompts from eval data
- Deployment to Agent Runtime, Cloud Run or GKE, with `infra single-project` and `infra cicd` provisioning the surrounding infrastructure and pipelines
- `publish gemini-enterprise` registers a finished agent with Gemini Enterprise
- Seven agent skills installed into Claude Code, Codex, Antigravity CLI or any other coding assistant, covering the ADK API, scaffolding, eval, deploy, publish and observability
- Observability wiring for Cloud Trace and logging, plus third-party integrations
Getting started
You need Python 3.11+, uv and Node.js. One command installs both the CLI and the skills; local development needs only an AI Studio API key.
Install the CLI and skills
`setup` installs the CLI and pushes the skills into the coding assistants it finds.
uvx google-agents-cli setupOr install just the skills
If you would rather let your coding agent handle the rest, add the skills on their own.
npx skills add google/agents-cliCreate and run an agent
Scaffold a project, install its dependencies, then drive it with a single prompt. Authentication goes through Google Cloud or AI Studio.
agents-cli login
agents-cli create my-agent
cd my-agent
agents-cli install
agents-cli run "summarise the attached report in three bullets"Evaluate before you ship
Synthesise eval scenarios, run and grade them, then look at where it went wrong — `eval analyze` clusters the failure modes rather than leaving you to read every trace.
agents-cli eval dataset synthesize
agents-cli eval run
agents-cli eval analyze
agents-cli eval compare before.json after.json
agents-cli eval optimizeDeploy and publish
Provision infrastructure, deploy to Google Cloud, and register the agent with Gemini Enterprise.
agents-cli infra single-project
agents-cli deploy
agents-cli publish gemini-enterpriseCommands and code are distilled from the project's own documentation — always check the official repo for the latest.
When to use it
- Take an ADK agent from an empty directory to a deployed, registered Gemini Enterprise agent without assembling the CI/CD and infrastructure yourself
- Give Claude Code or Codex working knowledge of ADK and Google Cloud deployment so it can build agents for you instead of guessing at the API
- Put a real evaluation loop around an agent — synthesised scenarios, graded traces, clustered failure modes, prompt auto-tuning — rather than eyeballing outputs
- Add production deployment, observability and CI/CD to an agent project that was prototyped without them
How Agents CLI compares
Agents CLI alongside other open-source agent frameworks & builders tools AI/TLDR tracks, ranked by GitHub stars.
| Tool | Stars | What it does |
|---|---|---|
| DeepSeek Harness | ★ 226k | DeepSeek AI's open-source agent harness (dsh), built on Cordis, where models, tools, skills, sessions, sandboxes, storage and the UI are all plugins composed through profiles. |
| AutoGPT | ★ 187k | One of the earliest autonomous agent projects, now a platform for building and running agents from reusable blocks and workflows. |
| DeerFlow | ★ 82.5k | ByteDance's open-source super agent harness built on LangGraph: skills, sub-agents, sandboxes, a filesystem and long-term memory for long-horizon research, coding and content tasks. |
| nanobot | ★ 48.2k | Lightweight self-hosted personal AI agent framework in Python, with a WebUI, terminal and chat-app channels, tools, long-term memory, MCP and scheduled automations. |
| Agno | ★ 42.2k | A fast Python framework (formerly Phidata) for building agents with memory, tools, and multimodal inputs, plus a runtime for deploying them in production. |
| LangGraph | ★ 41.8k | A library from the LangChain team for building stateful, graph-based agent workflows with explicit control over steps, memory, and human-in-the-loop checkpoints. |
| AgentGPT | ★ 36.3k | AgentGPT lets you name a custom AI, give it a goal, and watch it plan tasks, run them, and learn from the results, all from a web browser. |
| Agents CLI | ★ 5.9k | Scaffold, evaluate, deploy and publish ADK agents from one CLI — and hand the same commands to your coding assistant as skills |