# llama.cpp Build b8738 — Vendor-Agnostic Tensor Parallelism, 1-Bit Quantization, AMD CDNA4

> llama.cpp gains true multi-GPU tensor parallelism across CUDA, ROCm, and Metal — no vendor lock-in.

- Org: ggml-org
- Date: 2026-04-09
- Category: repo
- Source: https://github.com/ggml-org/llama.cpp/releases/tag/b8738
- Canonical page: https://ai-tldr.dev/releases/llama-cpp-b8738-tensor-parallelism/

## In short

April 2026 brought backend-agnostic tensor parallelism (3–4× faster than layer splitting), Q1_0 1-bit quantization under 1 GB for 7B models, Walsh-Hadamard KV cache rotation, and hardware support for AMD CDNA4 and Qualcomm Hexagon NPUs.

## What it is

llama.cpp is the most widely deployed local LLM inference engine with 108k GitHub stars. Build b8738 (April 9) delivered the headline feature: genuine tensor parallelism merged into mainline, alongside 1-bit quantization and a suite of hardware backend expansions across 170+ builds shipped in April.

## How it works

Tensor parallelism splits individual matrix operations across multiple GPUs simultaneously — unlike layer splitting, all GPUs process every token together. This works across NVIDIA CUDA, AMD ROCm, and Apple Metal without being locked to one vendor. Benchmarks showed 3–4× throughput gains over layer splitting with GPUs pegged at 100% utilization. Q1_0 1-bit quantization compresses 7B models below 1 GB by targeting binary-weight models. Walsh-Hadamard KV cache rotation unlocks Q4_0 KV quantization for reasoning tasks (previously unusable, now 21.7% on AIME25).

## Why it matters

Consumer-grade multi-GPU setups can now run MoE models like Llama 4 and Qwen 3 MoE efficiently, without CUDA-only infrastructure. 1-bit quantization pushes 7B inference onto ultra-constrained hardware.

## Who it's for

Local AI developers with multi-GPU rigs, edge hardware deployers, and hobbyists running large models on consumer hardware.

## Try it

Build from source: cmake -B build -DGGML_CUDA=ON -DGGML_TP=ON && cmake --build build -j

## Links

- [Build b8738 Release](https://github.com/ggml-org/llama.cpp/releases/tag/b8738)
- [April 2026 Summary](https://fazm.ai/blog/llama-cpp-release-april-2026)
- [GitHub](https://github.com/ggml-org/llama.cpp)