SYSTEM 01/14 · THE FIELD GUIDE
LLM Fundamentals
How large language models actually work — tokens, transformers, context windows, and why they make things up.
LLM Basics
The core ideas behind every AI model you'll ever call.
Tokens & Tokenization
The unit everything is priced, limited, and measured in.
Transformers & Attention
The architecture behind every modern model, without the math degree.
Transformer ModelsBEGINNERThe Attention MechanismBEGINNERMixture-of-Experts (MoE)ADVANCEDFlashAttentionADVANCEDPretraining vs Post-TrainingINTERMEDIATEEncoder vs Decoder ModelsINTERMEDIATEPositional EncodingINTERMEDIATEGrouped-Query AttentionADVANCEDSelf vs Cross-AttentionADVANCEDResiduals & Layer NormADVANCED
How Text Generation Works
From logits to the next word: how an LLM actually turns your prompt into text, one token at a time.
Context Windows & Model Memory
What a model can hold in its head at once — and what happens when it can't.
Sampling, Temperature & Hallucination
Why the same prompt gives different answers, and why some of them are wrong.