█

AI/TLDR

Buy me a coffee
Buy me a coffee

Edge0-145B

Edge0's open-weight 145B latent Mixture-of-Experts model, released November 12, 2026: derived from Qwen3.8-Flash-Next, about 10B active parameters per token, built to run on a single NVIDIA GPU.

IN SHORT

What is Edge0-145B?

Edge0-145B is an open-weight language model from Edge0, announced on November 12, 2026 together with a smaller Edge0-120B. It is a 145-billion-parameter latent Mixture-of-Experts model derived from Alibaba's Qwen3.8-Flash-Next and, per its model card, trained natively at 4 bits. It has a 256K-token context window.

Updated Checked against 2 sourcesMarkdown version ↗
Cite this pageAI/TLDR, "Edge0-145B: specs, pricing and benchmarks", https://ai-tldr.dev/models/edge0-145b/ (updated 12 November 2026)
// FACTSas of 12 November 2026
Context window256K tokens[1]
LicenceEdge0 Community Model License 1.0 (Qwen Community License 1.0 also applies) · open weights[1]
Released12 November 2026[2]
Parameters145B total · 10.12B active per token[1]
  1. [1] huggingface.co Hugging Face — Edge0-145B NVFP4
  2. [2] edge0.ai Edge0 — Introducing Edge0-145B
Edge0Open weightsOpen weights on Hugging Face in Q3_K and NVFP4 builds, released alongside a smaller Edge0-120B.
Released
12 Nov 2026
Context
256K tokens
Parameters
145B total · 10.12B active per token
License
Edge0 Community Model License 1.0 (Qwen Community License 1.0 also applies)
Coverage
1 story

Overview

Edge0-145B is an open-weight language model from Edge0, announced on November 12, 2026 together with a smaller Edge0-120B. It is a 145-billion-parameter latent Mixture-of-Experts model derived from Alibaba's Qwen3.8-Flash-Next and, per its model card, trained natively at 4 bits. Only about 10.12B parameters are active per token, and Edge0 built it to run on one consumer GPU instead of a data-center cluster.

Edge0's four-layer design diagram: grouped shared sparse experts, training for the on-device structure, a VRAM, RAM and SSD loading hierarchy, and CPU plus GPU scheduling with speculative decoding.
Edge0's design for running a 145B model on one computer: architecture, training, three-tier loading and CPU + GPU scheduling.Edge0 launch post ↗

The model card describes 48 layers with hybrid attention (full attention every fourth layer plus a sparse indexer), 512 experts per layer with 10 routed and 1 shared expert active per token, and a 256K context with an int8 KV cache. Groups of 64 experts share two large matrices while each expert keeps a small set of its own parameters, so the experts are small enough to be kept on the GPU, cached in system memory or swapped in on demand. Edge0's launch post puts the expert library at about 40 GB of system memory and about 48 GB of vocabulary data on the SSD, read as needed, with a multi-token-prediction head driving speculative decoding.

In Edge0's own evaluations the model scores 86.52 on Terminal-Bench 2.1 and 64.6 on DeepSWE 1.1, ahead of Qwen3.8-Flash-Next (83.3 and 58.7) and DeepSeek-V4-Flash-0731 (82.7 and 54.4), with a 72.8 mean across six benchmarks at 29 GB of measured peak memory. Qwen3.8-Flash-Next scores higher on HLE and GPQA-Diamond in the same table. Edge0 says the full evaluation setup is being released with its technical report.

The weights ship in Q3_K and NVFP4 builds and run on edge0-strata, the engine behind the Apache-2.0 edge0-infer command, which serves an OpenAI-compatible endpoint. The Edge0 README lists Linux and Windows with an NVIDIA GPU and CUDA 13 for the 145B and 120B models; its Apple M2 Ultra speed figures are marked as a Metal measurement, not macOS availability.

Released2026-11-12
LicenseEdge0 Community Model License 1.0 (Qwen Community License 1.0 also applies)
WeightsOpen weights
Parameters145B total · 10.12B active per token
Context256K tokens
ArchitectureLatent sparse Mixture-of-Experts: 48 layers, 512 experts per layer, 10 routed + 1 shared active per token, hybrid attention
ModalitiesText
StatusOpen weights on Hugging Face in Q3_K and NVFP4 builds, released alongside a smaller Edge0-120B.

Benchmarks

Edge0's chart plotting mean score across six benchmarks against peak memory: Edge0-145B at 29 GB and 72.8, Edge0-120B at 29 GB and 68.9, Qwen3.8-27B at about 18 GB and 66.1, Qwen3.8-Flash-Next at about 70 GB and 71.7, and DeepSeek-V4-Flash at about 87 GB and 70.1, with 48 GB laptop and 64 GB workstation lines marked.
Quality against peak memory: Edge0's measured peaks versus estimated standard 4-bit footprints for the baselines. — Edge0

Edge0-145B against open and closed models, transcribed from Edge0's launch post. Edge0, Qwen, DeepSeek and Claude scores are Edge0's internal evaluations; Flint, Muse Glimmer and Gemma 4 take Terminal-Bench 2.1 and IFBench from the Recursive Flint evaluation and HLE, GPQA and AA-LCR from Artificial Analysis. A dash means no public score.

BenchmarkEdge0-145BQwen3.8-Flash-NextQwen3.8-27BDeepSeek-V4-Flash-0731Flint 40BMuse GlimmerGemma 4Claude Opus 4.6 (Max)
DeepSWE 1.164.658.742.254.4————
Terminal-Bench 2.186.5283.37382.754.951.743.478.2
HLE35.435.930.833.8—2222.740
GPQA-Diamond90.491.789.290.8—83.585.791.3
IFBench80.681.379.579.289.2777662.5
AA-LCR79.379.18279.7—83.36278

Comparison source ↗

This model's scores

  1. GPQA-Diamond90.4%
  2. Terminal-Bench 2.186.52%
  3. IFBench80.6%
  4. AA-LCR79.3%
  5. DeepSWE 1.164.6%
  6. HLE35.4%

Scores on a 0–100 scale (25-point gridlines); higher is better. Each benchmark links to its published source.

Strengths

  • 145B total parameters with about 10.12B active per token, sized for a single 24 GB NVIDIA GPU plus system RAM
  • 86.52 on Terminal-Bench 2.1 and 64.6 on DeepSWE 1.1 in Edge0's internal evaluations
  • 256K context, Q3_K and NVFP4 builds, and an OpenAI-compatible local server through edge0-infer
  • Up to 121.2 tok/s agent decode on an RTX 5090 D 24 GB (Q3_K), per the model card

Best for

  • Reach for it for local agentic coding and terminal work on a Linux or Windows machine with one NVIDIA GPU, where no prompt or code should leave the machine.
  • Reach for it when a Qwen3.8-Flash-Next-class model will not fit your hardware with standard 4-bit weights.
  • Look elsewhere for macOS, image input or permissive licensing: the 145B model targets NVIDIA GPUs, is text-only, and its weights are under the Edge0 Community Model License plus the Qwen license.

FAQ

What is Edge0-145B?

Edge0-145B is an open-weight 145B-parameter latent Mixture-of-Experts language model from Edge0, announced on November 12, 2026. It is derived from Qwen3.8-Flash-Next, activates about 10.12B parameters per token, supports 256K tokens of context and is designed to run on a single consumer NVIDIA GPU.

How much memory does Edge0-145B need?

Edge0 reports 29 GB of measured peak memory. The launch post also keeps an expert library of about 40 GB in system memory and reads about 48 GB of vocabulary data from the SSD on demand; on an RTX 5090 D 24 GB the model card measures the NVFP4 build at 23.25 GiB of VRAM plus 38.27 GiB of RAM.

Which platforms does Edge0-145B run on?

The Edge0 README lists Linux and Windows with an NVIDIA GPU and CUDA 13 for the 145B and 120B models, through the edge0-strata engine started by edge0-infer. macOS is not listed for these models; the Apple M2 Ultra row in the speed table is a Metal measurement, not a release platform.

What license covers Edge0-145B?

The weights are under the Edge0 Community Model License 1.0, and because the model is derived from Qwen3.8-Flash-Next the Qwen Community License 1.0 also applies. The edge0 inference framework on GitHub is Apache-2.0.