Model comparison
Mistral Medium 3 vs Gemma 3
- Input
- $0.40 / 1M tokens
- Output
- $2.00 / 1M tokens
- Context
- 128K
- Released
- 2025-05-07
- Input
- $0.08
- Output
- $0.16
- Context
- 128K
- Released
- 2025-03-12
Mistral Medium 3 scores higher on 3 of the 3 benchmarks both models report; Gemma 3 is cheaper on input tokens ($0.1 vs $0.4 per 1M, 5×); Gemma 3 ships open weights while Mistral Medium 3 is API-only.
Specs and pricing side by side
| Spec | Mistral Medium 3 | Gemma 3 |
|---|---|---|
| Maker | Mistral AI | |
| Released | 2025-05-07 | 2025-03-12 |
| Context window | 128K | 128Ksame |
| Max output | not published | 8K |
| Input price | $0.40 / 1M tokens | $0.08 |
| Output price | $2.00 / 1M tokens | $0.16 |
| Parameters | not published | 1B · 4B · 12B · 27B (270M added Aug 2025) |
| License | Proprietary | Gemma Terms of Use |
| Weights | API only | Open weights |
| Modalities | Text, Vision, PDF | Text, Vision |
| Knowledge cutoff | Not disclosed | August 2024 |
Benchmarks both models report
| Benchmark | Mistral Medium 3 | Gemma 3 |
|---|---|---|
| HumanEval | 92.1% | 87.8% |
| MMLU Pro | 77.2% | 67.5% |
| GPQA Diamond | 57.1% | 42.4% |
Scores are as published by each maker or its cited source; harness, reasoning effort and date can differ between rows, so treat small gaps as ties. Sources are listed on each model page.
Which one should you pick?
Pick Mistral Medium 3 if…
- You care about HumanEval, MMLU Pro, GPQA Diamond (it scores higher on 3 shared benchmarks).
- You need PDF input, which Gemma 3 lacks.
- Your use case is: cost-sensitive enterprise coding assistants and code generation.
Pick Gemma 3 if…
- Cost matters: input tokens cost 5× less ($0.1 vs $0.4 per 1M).
- You want to self-host or fine-tune (open weights, Gemma Terms of Use).
- Your use case is: self-hosted chat and assistants where data must stay local.
FAQ
Which is better, Mistral Medium 3 or Gemma 3?
Mistral Medium 3 scores higher on 3 of the 3 benchmarks both models report; Gemma 3 is cheaper on input tokens ($0.1 vs $0.4 per 1M, 5×); Gemma 3 ships open weights while Mistral Medium 3 is API-only. The better pick depends on whether you value benchmark scores, price per token, context length or openness for your workload.
How much cheaper is Gemma 3?
Mistral Medium 3: $0.40 / 1M tokens input, $2.00 / 1M tokens output. Gemma 3: $0.08 input, $0.16 output (list API prices as published by each maker).
What are the context windows of Mistral Medium 3 and Gemma 3?
Mistral Medium 3 offers 128K; Gemma 3 offers 128K with up to 8K output.
Is Mistral Medium 3 newer than Gemma 3?
Mistral Medium 3 was released 2025-05-07; Gemma 3 was released 2025-03-12.