Ollama
From Homelab Chatbot to a Private AI Operations PlatformNew!!
A beginner-friendly guide to turning a local AI chatbot into a practical private AI operations platform with document search, automations, local tools, coding agents, monitoring, backups, upgrades, governance, and a realistic beginner roadmap.
Running Local AI Alongside Media Services Without Fighting Your GPUNew!!
Run Ollama, Tdarr, Plex, Jellyfin, and Frigate on the same homelab more safely by understanding NVENC, NVDEC, CUDA, VRAM, scheduling, and monitoring.
Performance Tuning Ollama and Local LLMs Without GuessworkNew!!
Make Ollama and other local LLM tools feel faster by matching the model, context length, quantization, GPU offload, and logs to the hardware you actually have.
Model Routing: Different Models for Different JobsNew!!
A noob-friendly guide to routing local AI prompts to the right model: Gemma for chat, Qwen Coder for code, Nemotron or reasoning models for planning, small models for summaries, and large models for hard tasks.
Nemotron and Agentic Local AINew!!
A practical guide to NVIDIA Nemotron models and agentic local AI: what a homelab can run, what needs bigger GPUs, and how to keep tools bounded and logged.
Local Coding Assistants: Codex CLI, Continue, Aider, and OpenHandsNew!!
A noob-friendly guide to choosing and safely using AI coding assistants in a local homelab, including Codex CLI, Continue, Aider, OpenHands, local models, hosted models, Git safety, and task scoping.
Securing a Self-Hosted AI ServerNew!!
A noob-friendly security guide for local AI homelabs: keep Ollama private, use VPN or reverse proxy access, manage accounts and API keys, protect logs, and handle private docs and code carefully.
Adding RAG: Chat with Documents Locally
A beginner-friendly guide to local document chat, embeddings, vector databases, Open WebUI knowledge bases, privacy, and common RAG mistakes.
Open WebUI Deep Dive: Users, Models, Documents, Prompts, and Safe Sharing
A noob-friendly tour of Open WebUI after installation: user accounts, model switching, documents, prompt shortcuts, admin settings, OpenAI-compatible endpoints, backups, updates, reverse proxy basics, and LAN/VPN security.
Local AI Hardware Sizing: CPU, NPU, GPU, RAM, and VRAM
A local AI hardware sizing guide explaining model memory, quantization, KV cache, CPU-only use, NPUs, GPUs, RAM, VRAM, and upgrade tiers.