1 · Your GPU
What GPU do you have?
Search for your card above (Apple Silicon routes to unified memory automatically).
Without a GPU we'll still show sizes and the quality guidance below.
Save your rig for one-click answers.
Your rig lives in this browser. A free account keeps it across the calculator, model pages and this helper.
Save my rig
2 · Model & context
Model (optional)
Choose a model to rank its quants…
bge-m3 — BAAI
bge-reranker-v2-m3 — BAAI
Cydonia-24B-v4.3 — TheDrummer
DeepSeek-R1-0528 — deepseek-ai
DeepSeek-R1-Distill-Llama-70B — deepseek-ai
DeepSeek-R1-Distill-Llama-8B — deepseek-ai
DeepSeek-R1-Distill-Qwen-1.5B — deepseek-ai
DeepSeek-R1-Distill-Qwen-14B — deepseek-ai
DeepSeek-R1-Distill-Qwen-32B — deepseek-ai
DeepSeek-R1-Distill-Qwen-7B — deepseek-ai
DeepSeek-V4-Flash — deepseek-ai
DeepSeek-V4-Pro — deepseek-ai
Devstral-Small-2-24B-Instruct-2512 — mistralai
Devstral-Small-2507 — mistralai
Dolphin3.0-Llama3.1-8B — dphn
dots.ocr — rednote-hilab
gemma-4-12B-it — google
gemma-4-26B-A4B-it — google
gemma-4-31B-it — google
gemma-4-E2B-it — google
gemma-4-E4B-it — google
GLM-4.7 — zai-org
GLM-4.7-Flash — zai-org
GLM-5.2 — zai-org
gpt-oss-120b — openai
gpt-oss-20b — openai
granite-4.0-h-micro — ibm-granite
granite-4.0-h-small — ibm-granite
granite-4.0-h-tiny — ibm-granite
Hermes-4-14B — NousResearch
Hermes-4-405B — NousResearch
Hermes-4-70B — NousResearch
Hy3 — tencent
InternVL3_5-38B-Instruct — OpenGVLab
InternVL3_5-8B-Instruct — OpenGVLab
Kimi-K2-Thinking — moonshotai
Kimi-K2.5 — moonshotai
Kimi-K2.6 — moonshotai
Kimi-K2.7-Code — moonshotai
Kokoro-82M — hexgrad
Llama-3_1-Nemotron-Ultra-253B-v1 — nvidia
Llama-3_3-Nemotron-Super-49B-v1 — nvidia
Llama-3.1-8B-Instruct — meta-llama
Llama-3.1-Nemotron-Nano-8B-v1 — nvidia
Llama-3.3-70B-Instruct — meta-llama
Llama-4-Scout-17B-16E-Instruct — meta-llama
MiniMax-M3 — MiniMaxAI
Mistral-Large-3-675B-Instruct-2512 — mistralai
Mistral-Small-3.2-24B-Instruct-2506 — mistralai
Mistral-Small-4-119B-2603 — mistralai
Mixtral-8x7B-Instruct-v0.1 — mistralai
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 — nvidia
nomic-embed-text-v1.5 — nomic-ai
nomic-embed-text-v2-moe — nomic-ai
Olmo-3-32B-Think — allenai
Olmo-3-7B-Instruct — allenai
Olmo-3.1-32B-Instruct — allenai
phi-4 — microsoft
Phi-4-mini-instruct — microsoft
Phi-4-multimodal-instruct — microsoft
Phi-4-reasoning — microsoft
Pixtral-12B-2409 — mistralai
Qwen2.5-7B-Instruct — Qwen
Qwen2.5-VL-72B-Instruct — Qwen
Qwen3-0.6B — Qwen
Qwen3-1.7B — Qwen
Qwen3-14B — Qwen
Qwen3-235B-A22B-Instruct-2507 — Qwen
Qwen3-235B-A22B-Thinking-2507 — Qwen
Qwen3-30B-A3B-Instruct-2507 — Qwen
Qwen3-30B-A3B-Thinking-2507 — Qwen
Qwen3-32B — Qwen
Qwen3-4B — Qwen
Qwen3-8B — Qwen
Qwen3-ASR-0.6B — Qwen
Qwen3-ASR-1.7B — Qwen
Qwen3-Coder-30B-A3B-Instruct — Qwen
Qwen3-Coder-480B-A35B-Instruct — Qwen
Qwen3-Embedding-0.6B — Qwen
Qwen3-Embedding-4B — Qwen
Qwen3-Embedding-8B — Qwen
Qwen3-Omni-30B-A3B-Instruct — Qwen
Qwen3-Reranker-0.6B — Qwen
Qwen3-Reranker-4B — Qwen
Qwen3-Reranker-8B — Qwen
Qwen3-TTS-12Hz-0.6B-Base — Qwen
Qwen3-TTS-12Hz-1.7B-Base — Qwen
Qwen3-VL-235B-A22B-Instruct — Qwen
Qwen3-VL-30B-A3B-Instruct — Qwen
Qwen3-VL-32B-Instruct — Qwen
Qwen3-VL-8B-Instruct — Qwen
Qwen3.5-0.8B — Qwen
Qwen3.5-122B-A10B — Qwen
Qwen3.5-27B — Qwen
Qwen3.5-2B — Qwen
Qwen3.5-35B-A3B — Qwen
Qwen3.5-397B-A17B — Qwen
Qwen3.5-4B — Qwen
Qwen3.5-9B — Qwen
Qwen3.6-27B — Qwen
Qwen3.6-35B-A3B — Qwen
QwQ-32B — Qwen
whisper-large-v3 — openai
whisper-large-v3-turbo — openai
Context length
2,048 tokens
4,096 tokens
8,192 tokens
16,384 tokens
32,768 tokens
KV-cache precision
FP16
Q8
Q4
Lower precision shrinks the KV cache (fits more context).