# Qwen2

> Alibaba's June 2024 open-weight family: 0.5B–72B dense plus a 57B-A14B MoE, GQA throughout and up to 128K context.

- Maker: Alibaba (Qwen)
- Line: Qwen (open-weight)
- Canonical page: https://ai-tldr.dev/models/qwen2/
- Updated: 2026-06-18

## In short

Qwen2 is the open-weight large language model family Alibaba's Qwen team released on June 7, 2024, succeeding Qwen1.5. You can use it through Hugging Face.

## Facts

| Fact | Value | Source |
| --- | --- | --- |
| Context window | Up to 128K (131,072) tokens | [1] |
| Licence | Apache 2.0 (0.5B, 1.5B, 7B, 57B-A14B); Tongyi Qianwen License (72B) · open weights | [1] |
| Released | 7 June 2024 | [2] |
| Parameters | 5 models: 0.5B, 1.5B, 7B and 72B dense, plus a 57B-A14B MoE (14B activated, 64 routed + 8 shared experts) | [1] |

## Sources

1. [Qwen2-72B-Instruct model card](https://huggingface.co/Qwen/Qwen2-72B-Instruct)
2. [Hello Qwen2 — official announcement](https://qwenlm.github.io/blog/qwen2/)

## Overview

Qwen2 is the open-weight large language model family Alibaba's Qwen team released on June 7, 2024, succeeding Qwen1.5. It ships in five sizes: dense Qwen2-0.5B, Qwen2-1.5B, Qwen2-7B and Qwen2-72B, plus a Mixture-of-Experts model, Qwen2-57B-A14B, that activates roughly 14B of its 57B parameters per token via 64 routed and 8 shared experts. Every size uses Grouped Query Attention (GQA), and the family shares a 151,643-token multilingual vocabulary covering English, Chinese and 27 additional languages.

Each base model ships alongside an instruction-tuned -Instruct variant. Context length varies by size: 32K tokens for the 0.5B and 1.5B, 64K for the 57B-A14B-Instruct, and up to 128K (131,072) tokens for the 7B-Instruct and 72B-Instruct. The flagship Qwen2-72B base model posts 84.2 on MMLU, 89.5 on GSM8K, 64.6 on HumanEval and 51.1 on MATH, beating contemporaries such as Llama 3 70B and Mixtral 8x22B on the Qwen team's reported numbers, while Qwen2-72B-Instruct reaches 86.0 on HumanEval and 91.1 on GSM8K.

On licensing, Qwen2 split its terms: the 0.5B, 1.5B, 7B and 57B-A14B models are released under Apache 2.0 for broad commercial use, while the 72B model keeps the more restrictive Tongyi Qianwen License. Qwen2 was the open-weight base that the much wider Qwen2.5 generation (September 2024) and later Qwen3 built on, and although it has been superseded, the weights remain freely downloadable from Hugging Face and ModelScope.

## Benchmarks

- MMLU (5-shot, base 72B): 84.2% ([source](https://qwenlm.github.io/blog/qwen2/))
- MMLU-Pro (base 72B): 55.6% ([source](https://qwenlm.github.io/blog/qwen2/))
- GPQA (base 72B): 37.9% ([source](https://qwenlm.github.io/blog/qwen2/))
- HumanEval (base 72B): 64.6% ([source](https://qwenlm.github.io/blog/qwen2/))
- MBPP (base 72B): 76.9% ([source](https://qwenlm.github.io/blog/qwen2/))
- GSM8K (base 72B): 89.5% ([source](https://qwenlm.github.io/blog/qwen2/))
- MATH (base 72B): 51.1% ([source](https://qwenlm.github.io/blog/qwen2/))
- HumanEval (72B-Instruct): 86% ([source](https://qwenlm.github.io/blog/qwen2/))
- GSM8K (72B-Instruct): 91.1% ([source](https://qwenlm.github.io/blog/qwen2/))
- MATH (72B-Instruct): 59.7% ([source](https://qwenlm.github.io/blog/qwen2/))

## Strengths

- Permissive Apache 2.0 license on all sizes except the 72B, enabling broad commercial and self-hosted use
- Wide size range — from a 0.5B edge model to a 72B flagship and a 57B-A14B MoE — covering on-device through server deployments
- GQA across every size for faster inference and lower KV-cache memory
- Up to 128K-token context on the 7B-Instruct and 72B-Instruct variants
- Strong multilingual coverage: English, Chinese and 27 additional languages
- Competitive 2024 benchmark scores: 84.2 MMLU and 89.5 GSM8K on the 72B base model

## Best for

- Self-hosted, license-friendly LLM deployment via Apache 2.0 weights (sub-72B sizes)
- On-device and edge inference with the 0.5B and 1.5B models
- Long-context document processing using the 128K-context Instruct variants
- Multilingual chat and assistant applications across 29 languages
- Cost-efficient MoE serving with Qwen2-57B-A14B (14B activated parameters)
- Coding and math tasks via Qwen2-Instruct and the companion Qwen2-Math models

## How to access

- [Hugging Face](https://huggingface.co/Qwen/Qwen2-72B-Instruct) — model id `Qwen/Qwen2-72B-Instruct`
- [Hugging Face](https://huggingface.co/Qwen/Qwen2-7B-Instruct) — model id `Qwen/Qwen2-7B-Instruct`
- [Hugging Face](https://huggingface.co/Qwen/Qwen2-57B-A14B-Instruct) — model id `Qwen/Qwen2-57B-A14B-Instruct`

## Qwen (open-weight) versions

- [Qwen3.6](https://ai-tldr.dev/models/qwen3-6/) (April 2026)
- [Qwen3.5](https://ai-tldr.dev/models/qwen3-5/) (16 February 2026)
- [Qwen3 (2507 update)](https://ai-tldr.dev/models/qwen3-2507/) (July 2025)
- [Qwen3](https://ai-tldr.dev/models/qwen3/) (28 April 2025)
- [Qwen2.5](https://ai-tldr.dev/models/qwen2-5/) (September 2024)
- Qwen2 (June 2024) — this page

## FAQ

### When was Qwen2 released and what sizes does it include?

Qwen2 was released on June 7, 2024. It includes five models: dense Qwen2-0.5B, Qwen2-1.5B, Qwen2-7B and Qwen2-72B, plus a Mixture-of-Experts model, Qwen2-57B-A14B, which activates about 14B of its 57B parameters per token. Each ships with an instruction-tuned -Instruct variant.

### What license does Qwen2 use?

It depends on the size. The 0.5B, 1.5B, 7B and 57B-A14B models use the permissive Apache 2.0 license, while the largest 72B model is released under the more restrictive Tongyi Qianwen License.

### How long is Qwen2's context window?

Context length varies by model: 32K tokens for the 0.5B and 1.5B, 64K for the 57B-A14B-Instruct, and up to 128K (131,072) tokens for the 7B-Instruct and 72B-Instruct.

### Is Qwen2 still the latest version?

No. Qwen2 was superseded by Qwen2.5 in September 2024 and later by Qwen3, which added more sizes, longer context and stronger coding and math performance. Qwen2's weights remain freely available on Hugging Face and ModelScope.

## Links

- [Hello Qwen2 — official announcement](https://qwenlm.github.io/blog/qwen2/)
- [Qwen2 Technical Report (arXiv 2407.10671)](https://arxiv.org/abs/2407.10671)
- [Qwen2-72B-Instruct model card](https://huggingface.co/Qwen/Qwen2-72B-Instruct)
- [Qwen2 collection on Hugging Face](https://huggingface.co/collections/Qwen/qwen2-6659360b33528ced941e557f)
- [Qwen — official site](https://qwen.ai)

Source: AI/TLDR LLM registry, https://ai-tldr.dev/models/qwen2/