█

AI/TLDR

Buy me a coffee
Buy me a coffee

Model comparison

GLM-4-9B vs Mixtral 8x7B

Short answer

GLM-4-9B scores higher on 4 of the 4 benchmarks both models report; GLM-4-9B has the larger context window (128K vs 32K).

Specs and pricing side by side

SpecGLM-4-9BMixtral 8x7B
MakerZ.ai (Zhipu / GLM)Mistral AI
Released2024-06-052023-12-09
Context window128K32K tokens
Max outputNot publicly disclosedNot officially specified; bounded by the…
Input priceFree$0.70 / 1M tokens
Output priceFree$0.70 / 1M tokens
Parameters9B46.7B total parameters, 12.9B active per token (8 experts, 2 routed per token)
LicenseGLM-4 License (custom open weights)Apache 2.0
WeightsOpen weightsOpen weightssame
ModalitiesTextTextsame
Knowledge cutoffNot publicly disclosedNot officially published by Mistral AI

Benchmarks both models report

BenchmarkGLM-4-9BMixtral 8x7B
MMLU72.4%70.6%
GSM8K79.6%74.4%
MATH50.6%28.4%
HumanEval71.8%40.2%

Scores are as published by each maker or its cited source; harness, reasoning effort and date can differ between rows, so treat small gaps as ties. Sources are listed on each model page.

Which one should you pick?

Pick GLM-4-9B if…

  • You care about MMLU, GSM8K, MATH (it scores higher on 4 shared benchmarks).
  • You need the longer context (128K vs 32K).
  • Your use case is: local and on-device chat assistants where a small open model is preferred.

Pick Mixtral 8x7B if…

  • Your use case is: self-hosted chat assistants and RAG backends where Apache 2.0 licensing matters.

FAQ

Which is better, GLM-4-9B or Mixtral 8x7B?

GLM-4-9B scores higher on 4 of the 4 benchmarks both models report; GLM-4-9B has the larger context window (128K vs 32K). The better pick depends on whether you value benchmark scores, price per token, context length or openness for your workload.

What are the context windows of GLM-4-9B and Mixtral 8x7B?

GLM-4-9B offers 128K with up to Not publicly disclosed output; Mixtral 8x7B offers 32K tokens with up to Not officially specified; bounded by the 32K-token context window output.

Is GLM-4-9B newer than Mixtral 8x7B?

GLM-4-9B was released 2024-06-05; Mixtral 8x7B was released 2023-12-09.

Go deeper