# Kaggle Benchmarks Goes Local — Google Lets Coding Agents Author Eval Tasks From VS Code, Cursor, and Antigravity Through a Kaggle CLI, an SDK, and a 'write-kaggle-benchmarks' Skill

> Google opens Kaggle Benchmarks authoring to any local IDE so coding agents can build new eval tasks themselves.

- Org: Google / Kaggle
- Date: 2026-06-04
- Category: tool, benchmark
- Source: https://blog.google/innovation-and-ai/technology/developers-tools/build-kaggle--benchmarks-locally/
- Canonical page: https://ai-tldr.dev/releases/google-kaggle-benchmarks-local-cli/

## In short

Google opens Kaggle Benchmarks task authoring to local dev environments. A new Kaggle CLI benchmarks subcommand, the kaggle-benchmarks Python SDK, and an agent skill let developers write, push, and run evaluations from VS Code, Cursor, or Antigravity instead of the web editor.

## What it is

Kaggle Benchmarks is the community leaderboard system Google launched late last year for measuring model capabilities on user-submitted evaluation tasks. Until now you could only build tasks in Kaggle's web editor; this update opens that to any local dev environment.

## How it works

The Kaggle CLI gains a benchmarks subcommand tree: `auth` and `init` fetch Model Proxy credentials, and `tasks push / run / list / status / download / publish` manage tasks end-to-end. Tasks are defined in Python against the kaggle-benchmarks SDK. A 'write-kaggle-benchmarks' skill ships in Kaggle/kaggle-skills to teach coding agents like Antigravity and Cursor how to call the SDK and CLI through natural-language instructions.

## Why it matters

Authoring evaluations is the slow part of a benchmark race. Closing the loop between Cursor or Antigravity and Kaggle Benchmarks means anyone can spin up a task in their IDE, push it to the public leaderboard, and have it scored against the catalogue of frontier models without leaving their editor.

## Who it's for

ML researchers, eval engineers, and Antigravity / Cursor / VS Code users who want their agent to author benchmark tasks.

## Try it

kaggle benchmarks init

## Links

- [Announcement](https://blog.google/innovation-and-ai/technology/developers-tools/build-kaggle--benchmarks-locally/)
- [kaggle-benchmarks Repo](https://github.com/Kaggle/kaggle-benchmarks)
- [Local Dev Docs](https://github.com/Kaggle/kaggle-benchmarks/blob/ci/local_development.md)
- [Kaggle CLI Repo](https://github.com/Kaggle/kaggle-cli)
- [Agent Skill](https://github.com/Kaggle/kaggle-skills/blob/main/write-kaggle-benchmarks/SKILL.md)