Plain-language explainers for running open-weight models locally.
GGUF, AWQ, GPTQ, EXL2 and MLX — what they are, and what Q4_K_M means.
How model size, quantization and context add up to a memory budget.
Why a longer context costs memory, and what KV-cache quantization trades.