Skip to content

← All series & guides

Series

Fine-tuning open models with Unsloth from scratch

This path is for you if you want to change an open model's weights, not only write a better prompt. The tool is Unsloth, and the split is a prompt versus a weight update. No part is live on this page yet. Start with Meta Llama from scratch if you still need the map of the model, and come back here for the training path.

  1. 1 What does fine-tuning an AI model actually do? Separate prompts, RAG, and weight fine-tuning. Fine-tune for style and schema discipline; retrieve for changing facts; stop paying a huge prompt tax at scale. Scheduled · November 23, 2026
  2. 2 Why Unsloth Matters: Faster Fine-Tuning With Less Memory Unsloth rewrites training code for common model types so fine-tuning runs faster with less GPU memory. As of October 2026 it reports about 2x speed and up to 70% less VRAM, with no approximations. Scheduled · November 25, 2026
  3. 3 What are LoRA and QLoRA? Cheaper ways to fine-tune an AI model Configure LoRA and QLoRA with sensible rank, alpha, and 4-bit NormalFloat bases. Smaller adapters often train faster and generalize better than oversized ranks. Scheduled · November 27, 2026
  4. 4 How to prepare a dataset for fine-tuning an AI model Prepare fine-tuning datasets with clear formats, response-only loss, and high-signal examples. Volume without quality wastes GPU rent. Scheduled · December 1, 2026
  5. 5 Hands-On Fine-Tuning in Colab: Training Llama 3.1 8B on a Free GPU Fine-tune Llama 3.1 8B on a free Colab GPU with Unsloth: load it in 4-bit, add LoRA adapters, train on the answers only, then measure your own time and memory. Scheduled · December 3, 2026
  6. 6 How to save and share a fine-tuned AI model: on a laptop, a server, or Hugging Face Export Unsloth adapters as merged SafeTensors, GGUF for Ollama, and Hub uploads for vLLM serving. Pick the artifact that matches each runtime. Scheduled · December 6, 2026