Skip to content

Tag

#llama-cpp

Every story tagged llama-cpp, newest first.

How to run a local LLM on your own machine with Ollama
Tutorial · software

How to run a local LLM on your own machine with Ollama

Install Ollama, pull a model, and chat with it offline in about ten minutes. No cloud account, no API key, and nothing leaves your laptop.

Muniba K. · May 24, 2026 · 4 min read

How to choose the right quantization for a local LLM
Tutorial · aiDeep read

How to choose the right quantization for a local LLM

Decode the Q4, Q5, and Q8 labels on model files, understand what bits-per-weight actually costs you, and pick a quantization that fits your RAM without wrecking quality.

BitByteCore Research · May 24, 2026 · 4 min read