Skip to content

← All series & guides

Series

Local LLMs from scratch

2 parts

This path is for you if the model has to run on a machine you control, with no monthly chat bill. No part is live on this page yet. Start with Run open models, which is the live path for a hosted chat, a desktop runner, and one local stack.

Start with part 1 →

  1. 1 Why run an AI model on your own computer? Privacy, cost, and offline use Choose local inference for data boundary, offline, and learning. Choose cloud when quality and convenience win. Say where the prompt goes before you promise privacy.
  2. 2 What hardware do you need to run AI on your own computer? Size local hardware from model memory and bandwidth, not from brand stickers. Prefer enough unified or GPU memory, then worry about fancy cores.
  3. 3 What is AI model quantization? How smaller model files trade quality for size Treat GGUF quantization tiers as memory-vs-quality dials. Prefer mid tiers for work you will cite, and test your own prompts before you standardize on the tiniest file. Scheduled · October 28, 2026
  4. 4 How to run AI on your own computer with Ollama in one command Start local with Ollama: install, pull a sized tag, run, then automate with the local API. Pick models that fit RAM. Keep a verify step for anything that ships. Scheduled · October 30, 2026
  5. 5 How to run AI models on your computer with LM Studio Use LM Studio or a peer GUI when the audience needs buttons. Load a fitting model, set GPU offload and context deliberately, and use the local endpoint from your apps. Scheduled · November 1, 2026
  6. 6 What is llama.cpp, and why do so many local AI apps use it? Learn llama.cpp as the common local engine: mmap loads, GGML math, and a simple server. Many GUIs wrap it. Debug the wrapper before you blame the weights. Scheduled · November 3, 2026
  7. 7 Useful things to do with an AI model that runs offline on your computer Use local models for offline notes cleanup, private contract extraction, and sensitive rewrites. Keep temperature low for facts, chunk long docs, and leave confidential text off cloud tabs. Scheduled · November 5, 2026
  8. 8 How to keep local AI models updated without breaking your setup Treat local models like production software: pin tags, audit disk, version Modelfiles, and regression-test upgrades. Latest is a moving pointer, not a release. Scheduled · November 7, 2026
  9. 9 When a $20 ChatGPT or Claude subscription beats running AI on your own computer Keep local for confidential and routine text. Keep a frontier seat for hard reasoning and vision. Hybrid routing beats "everything local" dogma. Scheduled · November 9, 2026