Model comparison
Claude 3 Sonnet vs Gemini 1.0 Pro
- Input
- $3.00
- Output
- $15.00
- Context
- 200K
- Released
- 2024-03-04
- Input
- $0.50
- Output
- $1.50
- Context
- 32K tokens (~32,760 input)
- Released
- 2023-12-13
Claude 3 Sonnet scores higher on 3 of the 3 benchmarks both models report; Gemini 1.0 Pro is cheaper on input tokens ($0.5 vs $3 per 1M, 6×); Claude 3 Sonnet has the larger context window (200K vs 32K).
Specs and pricing side by side
| Spec | Claude 3 Sonnet | Gemini 1.0 Pro |
|---|---|---|
| Maker | Anthropic | |
| Released | 2024-03-04 | 2023-12-13 |
| Context window | 200K | 32K tokens (~32,760 input) |
| Max output | 4K | 8,192 tokens |
| Input price | $3.00 | $0.50 |
| Output price | $15.00 | $1.50 |
| Parameters | not published | Undisclosed |
| License | Proprietary | Proprietarysame |
| Weights | API only | API onlysame |
| Modalities | Text, Vision | Text, Vision (image input, via Gemini 1.0 Pro Vision) |
| Knowledge cutoff | August 2023 | Early 2023 (around April 2023) |
Benchmarks both models report
| Benchmark | Claude 3 Sonnet | Gemini 1.0 Pro |
|---|---|---|
| MMLU | 79% | 71.8% |
| HumanEval | 73% | 67.7% |
| GSM8K | 92.3% | 86.5% |
Scores are as published by each maker or its cited source; harness, reasoning effort and date can differ between rows, so treat small gaps as ties. Sources are listed on each model page.
Which one should you pick?
Pick Claude 3 Sonnet if…
- You care about MMLU, HumanEval, GSM8K (it scores higher on 3 shared benchmarks).
- You need the longer context (200K vs 32K).
- You need Vision input, which Gemini 1.0 Pro lacks.
- Your use case is: general-purpose text generation and summarization.
Pick Gemini 1.0 Pro if…
- Cost matters: input tokens cost 6× less ($0.5 vs $3 per 1M).
- You need Vision (image input, via Gemini 1.0 Pro Vision) input, which Claude 3 Sonnet lacks.
- Your use case is: multi-turn text and code chat assistants.
FAQ
Which is better, Claude 3 Sonnet or Gemini 1.0 Pro?
Claude 3 Sonnet scores higher on 3 of the 3 benchmarks both models report; Gemini 1.0 Pro is cheaper on input tokens ($0.5 vs $3 per 1M, 6×); Claude 3 Sonnet has the larger context window (200K vs 32K). The better pick depends on whether you value benchmark scores, price per token, context length or openness for your workload.
How much cheaper is Gemini 1.0 Pro?
Claude 3 Sonnet: $3.00 input, $15.00 output. Gemini 1.0 Pro: $0.50 input, $1.50 output (list API prices as published by each maker).
What are the context windows of Claude 3 Sonnet and Gemini 1.0 Pro?
Claude 3 Sonnet offers 200K with up to 4K output; Gemini 1.0 Pro offers 32K tokens (~32,760 input) with up to 8,192 tokens output.
Is Claude 3 Sonnet newer than Gemini 1.0 Pro?
Claude 3 Sonnet was released 2024-03-04; Gemini 1.0 Pro was released 2023-12-13.