Mercor · 2026-10-15 · notable
Mercor Benchmark Map — 90% of US work hours lack good AI benchmarks
Mercor's Benchmark Map checks 29 AI benchmarks against the US government's O*NET job taxonomy. Only 208 of 923 occupations have a well-covered task, and Mercor estimates 90% of US work hours have little or no coverage.
A map of which US jobs today's AI benchmarks actually measure, and how many work hours they miss.
Key specs
| Occupations covered | 208 / 923 |
|---|---|
| Benchmarks mapped | 29 |
What is it?
The Benchmark Map of the US Economy is a research page Mercor released on 15 October 2026 as part of its Labor Index. It maps the prompts in 29 public AI benchmarks onto the tasks in O*NET, the US Department of Labor's catalog of 923 occupations and 18,797 tasks. Mercor calls the results provisional.
How does it work?
An LLM judge tags every benchmark prompt with the O*NET tasks it matches, and Mercor checked those tags against human expert tags on its APEX benchmark. A task counts as covered when it has at least 5 mapped prompts, which holds for 924 tasks. Hours per task come from published time-use estimates, which gives the 90% figure for hours with little or no coverage.
Why does it matter?
Benchmark scores are often read as a measure of how much work AI can do, but the map shows they sample a narrow slice. Coverage leans toward AI-exposed, high-wage work: lawyers are well covered while legal secretaries and court clerks are barely covered, and 6 of 22 job families have no covered occupation at all. Mercor sells expert data and evaluations, so the gap it finds is also its market.
Who is it for?
AI researchers, eval builders and economists