█

AI/TLDR

Buy me a coffee
Buy me a coffee
PROMOTE YOUR WEBSITE IN JUST $20

Model comparison

Gemini 1.5 Flash vs Claude 3 Opus

GoogleGemini 1.5 Flash
Input
$0.075 per 1M tokens (prompts ≤128K tokens)
Output
$0.30 per 1M tokens (prompts ≤128K tokens)
Context
1,048,576 tokens (1M)
Released
2024-05-14
Full model page →AnthropicClaude 3 Opus
Input
$15.00
Output
$75.00
Context
200K
Released
2024-03-04
Full model page →
Short answer

Claude 3 Opus scores higher on 4 of the 4 benchmarks both models report; Gemini 1.5 Flash is cheaper on input tokens ($0.1 vs $15 per 1M, 200×); Gemini 1.5 Flash has the larger context window (1.048576M vs 200K).

Specs and pricing side by side

SpecGemini 1.5 FlashClaude 3 Opus
MakerGoogleAnthropic
Released2024-05-142024-03-04
Context window1,048,576 tokens (1M)200K
Max output8,192 tokens4K
Input price$0.075 per 1M tokens (prompts ≤128K tokens)$15.00
Output price$0.30 per 1M tokens (prompts ≤128K tokens)$75.00
ParametersNot disclosedUndisclosed
LicenseProprietaryProprietarysame
WeightsAPI onlyAPI onlysame
ModalitiesText, Image, Audio, VideoText, Vision
Knowledge cutoffNovember 2023August 2023

Benchmarks both models report

BenchmarkGemini 1.5 FlashClaude 3 Opus
MMLU78.9%86.8%
MATH54.9%60.1%
GSM8K86.2%95%
HumanEval74.3%84.9%

Scores are as published by each maker or its cited source; harness, reasoning effort and date can differ between rows, so treat small gaps as ties. Sources are listed on each model page.

Which one should you pick?

Pick Gemini 1.5 Flash if…

  • Cost matters: input tokens cost 200× less ($0.1 vs $15 per 1M).
  • You need the longer context (1.048576M vs 200K).
  • You need Image / Audio / Video input, which Claude 3 Opus lacks.
  • Your use case is: summarizing long documents, transcripts, and multi-hour audio or video.

Pick Claude 3 Opus if…

  • You care about MMLU, MATH, GSM8K (it scores higher on 4 shared benchmarks).
  • You need Vision input, which Gemini 1.5 Flash lacks.
  • Your use case is: complex reasoning, analysis and long-document understanding over the 200K window.

FAQ

Which is better, Gemini 1.5 Flash or Claude 3 Opus?

Claude 3 Opus scores higher on 4 of the 4 benchmarks both models report; Gemini 1.5 Flash is cheaper on input tokens ($0.1 vs $15 per 1M, 200×); Gemini 1.5 Flash has the larger context window (1.048576M vs 200K). The better pick depends on whether you value benchmark scores, price per token, context length or openness for your workload.

How much cheaper is Gemini 1.5 Flash?

Gemini 1.5 Flash: $0.075 per 1M tokens (prompts ≤128K tokens) input, $0.30 per 1M tokens (prompts ≤128K tokens) output. Claude 3 Opus: $15.00 input, $75.00 output (list API prices as published by each maker).

What are the context windows of Gemini 1.5 Flash and Claude 3 Opus?

Gemini 1.5 Flash offers 1,048,576 tokens (1M) with up to 8,192 tokens output; Claude 3 Opus offers 200K with up to 4K output.

Is Gemini 1.5 Flash newer than Claude 3 Opus?

Gemini 1.5 Flash was released 2024-05-14; Claude 3 Opus was released 2024-03-04.

Go deeper