Model comparison
Gemini 1.5 Flash-8B vs GPT-4o mini
- Input
- $0.0375 / 1M tokens (prompts < 128K)
- Output
- $0.15 / 1M tokens (prompts < 128K)
- Context
- 1M
- Released
- 2024-10-03
- Input
- $0.15 per 1M tokens
- Output
- $0.60 per 1M tokens
- Context
- 128K tokens
- Released
- 2024-07-18
GPT-4o mini scores higher on 5 of the 5 benchmarks both models report; Gemini 1.5 Flash-8B is cheaper on input tokens ($0 vs $0.2 per 1M, 4×); Gemini 1.5 Flash-8B has the larger context window (1M vs 128K).
Specs and pricing side by side
| Spec | Gemini 1.5 Flash-8B | GPT-4o mini |
|---|---|---|
| Maker | OpenAI | |
| Released | 2024-10-03 | 2024-07-18 |
| Context window | 1M | 128K tokens |
| Max output | 8K | 16,384 tokens |
| Input price | $0.0375 / 1M tokens (prompts < 128K) | $0.15 per 1M tokens |
| Output price | $0.15 / 1M tokens (prompts < 128K) | $0.60 per 1M tokens |
| Parameters | ~8B (single-digit billions; exact count undisclosed) | Not disclosed by OpenAI |
| License | Proprietary | Proprietary (OpenAI commercial terms; available via API and ChatGPT) |
| Weights | API only | API onlysame |
| Modalities | Text, Vision, Audio, Video | text input, image input (vision), text output |
| Knowledge cutoff | August 2024 | October 2023 |
Benchmarks both models report
| Benchmark | Gemini 1.5 Flash-8B | GPT-4o mini |
|---|---|---|
| MMLU | 68.1% | 82% |
| GPQA | 30.8% | 40.2% |
| MATH | 35.9% | 70.2% |
| MGSM | 70.5% | 87% |
| MMMU | 50.3% | 59.4% |
Scores are as published by each maker or its cited source; harness, reasoning effort and date can differ between rows, so treat small gaps as ties. Sources are listed on each model page.
Which one should you pick?
Pick Gemini 1.5 Flash-8B if…
- Cost matters: input tokens cost 4× less ($0 vs $0.2 per 1M).
- You need the longer context (1M vs 128K).
- You need Text / Vision / Audio / Video input, which GPT-4o mini lacks.
- Your use case is: high-volume chat, summarization, and classification where cost-per-token dominates.
Pick GPT-4o mini if…
- You care about MMLU, GPQA, MATH (it scores higher on 5 shared benchmarks).
- You need text input / image input (vision) / text output input, which Gemini 1.5 Flash-8B lacks.
- Your use case is: high-volume text classification, tagging, and content moderation where cost per call matters.
FAQ
Which is better, Gemini 1.5 Flash-8B or GPT-4o mini?
GPT-4o mini scores higher on 5 of the 5 benchmarks both models report; Gemini 1.5 Flash-8B is cheaper on input tokens ($0 vs $0.2 per 1M, 4×); Gemini 1.5 Flash-8B has the larger context window (1M vs 128K). The better pick depends on whether you value benchmark scores, price per token, context length or openness for your workload.
How much cheaper is Gemini 1.5 Flash-8B?
Gemini 1.5 Flash-8B: $0.0375 / 1M tokens (prompts < 128K) input, $0.15 / 1M tokens (prompts < 128K) output. GPT-4o mini: $0.15 per 1M tokens input, $0.60 per 1M tokens output (list API prices as published by each maker).
What are the context windows of Gemini 1.5 Flash-8B and GPT-4o mini?
Gemini 1.5 Flash-8B offers 1M with up to 8K output; GPT-4o mini offers 128K tokens with up to 16,384 tokens output.
Is Gemini 1.5 Flash-8B newer than GPT-4o mini?
Gemini 1.5 Flash-8B was released 2024-10-03; GPT-4o mini was released 2024-07-18.