moonshotai
Kimi-K3
2,779.9B parameters · mixture-of-experts · Instruct · Kimi family
Nothing to download yet — not yet mirrored
We haven't mirrored a torrent for this model yet. The metadata is cataloged, but no downloadable build exists here right now.
Request this model on the boardRecommended download
Which version should I download?
Default pick: safetensors · BF16
Set your rig to confirm it fits and to see if a higher-quality quant runs fully on your hardware.
| Format | Level | Size | Verdict | Est. speed | Quality note | Swarm | Download |
|---|---|---|---|---|---|---|---|
| safetensors | BF16 | 1.42 TB | Set your rig | — | — | — | Not yet available |
Want a different quant? Request it on the board →
Context
Advertised 1M · no independent evidence yet
No independent long-context evidence has been graded for this model yet — the advertised window above is the maintainer's number, not a usable-context claim.
Run it
Context / KV 8,192 tokens · FP16 set above the quant table
Generic commands (no rig set). GPU-offload values assume the model fits on your GPU — set your rig for values tuned to your hardware.
llama.cpp loads GGUF files only; this quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
Ollama runs GGUF builds only; this quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
vllm serve moonshotai/Kimi-K3 --max-model-len 8192Serves on http://localhost:8000/v1 by default.
pip install transformers accelerate torchfrom transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "moonshotai/Kimi-K3"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
dtype="auto",
device_map="auto",
)Loads the weights straight from the repo; point model_id at a local directory to use your downloaded copy.
LM Studio loads GGUF (and MLX on Apple Silicon) only; this quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
MLX runs MLX-format weights only (Apple Silicon). This quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
Technical details
No template or sampling metadata recorded.
Evidence & provenance
Source
- Provenance
- https://huggingface.co/moonshotai/Kimi-K3
- Revision pin
-
9f62e4e9fffbd0a83ddd60e1c209d828994b3569 - Manifest
- None
License
- Name
- kimi-k3
- Commercial use
- unclear
- Access
- Open
File hashes (SHA-256)
No file hashes recorded yet.
Explore further
Get an email when a better quant fits your rig.
Set your rig once; we'll alert you when a new or better-fitting build lands.
Performance reports
Real-world throughput reported by the community (and scraped sources).
Community
Reviews, sampler presets and community runtime reports. Be the first to contribute.
Community runtime reports
Unofficial, community-submitted "it loads for me" reports. These are not the official verified-working badge — an admin reviews reports before anything is marked officially verified.
Log in to report whether a quant loads in your runtime.
No community reports yet.