Model comparison
GLM-4-9B vs Gemini 1.5 Flash
- Input
- Free
- Output
- Free
- Context
- 128K
- Released
- 2024-06-05
- Input
- $0.075 per 1M tokens (prompts ≤128K tokens)
- Output
- $0.30 per 1M tokens (prompts ≤128K tokens)
- Context
- 1,048,576 tokens (1M)
- Released
- 2024-05-14
Gemini 1.5 Flash scores higher on 5 of the 5 benchmarks both models report; Gemini 1.5 Flash has the larger context window (1.048576M vs 128K); GLM-4-9B ships open weights while Gemini 1.5 Flash is API-only.
Specs and pricing side by side
| Spec | GLM-4-9B | Gemini 1.5 Flash |
|---|---|---|
| Maker | Z.ai (Zhipu / GLM) | |
| Released | 2024-06-05 | 2024-05-14 |
| Context window | 128K | 1,048,576 tokens (1M) |
| Max output | Not publicly disclosed | 8,192 tokens |
| Input price | Free | $0.075 per 1M tokens (prompts ≤128K tokens) |
| Output price | Free | $0.30 per 1M tokens (prompts ≤128K tokens) |
| Parameters | 9B | Not disclosed |
| License | GLM-4 License (custom open weights) | Proprietary |
| Weights | Open weights | API only |
| Modalities | Text | Text, Image, Audio, Video |
| Knowledge cutoff | Not publicly disclosed | November 2023 |
Benchmarks both models report
| Benchmark | GLM-4-9B | Gemini 1.5 Flash |
|---|---|---|
| MMLU | 72.4% | 78.9% |
| GSM8K | 79.6% | 86.2% |
| MATH | 50.6% | 54.9% |
| HumanEval | 71.8% | 74.3% |
| GPQA | 34.3% | 39.5% |
Scores are as published by each maker or its cited source; harness, reasoning effort and date can differ between rows, so treat small gaps as ties. Sources are listed on each model page.
Which one should you pick?
Pick GLM-4-9B if…
- You want to self-host or fine-tune (open weights, GLM-4 License (custom open weights)).
- Your use case is: local and on-device chat assistants where a small open model is preferred.
Pick Gemini 1.5 Flash if…
- You care about MMLU, GSM8K, MATH (it scores higher on 5 shared benchmarks).
- You need the longer context (1.048576M vs 128K).
- You need Image / Audio / Video input, which GLM-4-9B lacks.
- Your use case is: summarizing long documents, transcripts, and multi-hour audio or video.
FAQ
Which is better, GLM-4-9B or Gemini 1.5 Flash?
Gemini 1.5 Flash scores higher on 5 of the 5 benchmarks both models report; Gemini 1.5 Flash has the larger context window (1.048576M vs 128K); GLM-4-9B ships open weights while Gemini 1.5 Flash is API-only. The better pick depends on whether you value benchmark scores, price per token, context length or openness for your workload.
What are the context windows of GLM-4-9B and Gemini 1.5 Flash?
GLM-4-9B offers 128K with up to Not publicly disclosed output; Gemini 1.5 Flash offers 1,048,576 tokens (1M) with up to 8,192 tokens output.
Is GLM-4-9B newer than Gemini 1.5 Flash?
GLM-4-9B was released 2024-06-05; Gemini 1.5 Flash was released 2024-05-14.