Local & Open Models · TRACK 01/04
Running Models Locally
From zero to a model running on your laptop in one evening.
// THE TRACK
01 · START HERELocal LLMsAfter reading you will know exactly what a local LLM is and when running one beats calling a cloud API.BEGINNEROllamaYou will go from nothing installed to chatting with a local model through Ollama, and understand what it does under the hood.BEGINNERRunning OllamaAfter reading you will be able to install Ollama, pull a model, chat from the terminal, and call the local OpenAI-compatible API from your own code.BEGINNERllama.cppYou will understand what llama.cpp actually is, why nearly every local AI app is built on it, and when to use it directly.BEGINNERLM Studio vs Ollama vs JanYou will be able to pick the right local LLM app for your needs instead of installing all three and guessing.BEGINNERHardware: RAM & VRAMYou will be able to look at any model size and quantization level and calculate whether your machine can run it.INTERMEDIATELLMs on a PhoneYou will understand what it takes to run a language model on a phone, which small models fit, and what NPUs change about the math.INTERMEDIATELLMs on a MacYou will understand why Macs punch above their weight for local AI and how to get the most out of yours.INTERMEDIATEGPU OffloadingYou will understand how splitting model layers between VRAM and RAM lets you run a model too big for your GPU, and exactly why each offloaded layer slows you down.INTERMEDIATELLMs on WindowsYou will get a model running on your Windows PC the right way, knowing when native apps suffice and when WSL2 actually helps.BEGINNERTokens per SecondYou will know how to read and measure tokens-per-second numbers, and judge whether a setup is fast enough before you commit to a model.BEGINNERLM StudioYou will understand what LM Studio is, how its desktop GUI lets you browse and run open models with no command line, and how its local server connects to your own apps.BEGINNEROpen WebUIYou will understand what Open WebUI is, how it gives local models a polished ChatGPT-style web interface, and how it connects to Ollama and OpenAI-compatible backends.BEGINNERJanYou will understand what Jan is, how its offline-first desktop app runs open models locally as a private ChatGPT alternative, and when it can also use cloud models.BEGINNER