Quantization

Homelab
Performance Tuning Ollama and Local LLMs Without Guesswork

Tune Ollama from a repeatable baseline, checking model fit, context, memory placement, concurrency, and answer quality; change one setting at a time and keep a rollback path.

Read this guide
AI
Local AI Hardware Sizing: CPU, NPU, GPU, RAM, and VRAM

A local AI hardware sizing guide explaining model memory, quantization, KV cache, CPU-only use, NPUs, GPUs, RAM, VRAM, and upgrade tiers.

Read this guide