moonshotai
Kimi-K3
2,779.9B parameters · mixture-of-experts · Base · Kimi family
Nothing to download yet — not yet mirrored
We haven't mirrored a torrent for this model yet. The metadata is cataloged, but no downloadable build exists here right now.
Request this model on the boardRecommended download
Which version should I download?
Default pick: safetensors · unknown
Set your rig to confirm it fits and to see if a higher-quality quant runs fully on your hardware.
| Format | Level | Size | Verdict | Est. speed | Quality note | Swarm | Download |
|---|---|---|---|---|---|---|---|
| safetensors | unknown | — | Set your rig | — | — | — | Not yet available |
Want a different quant? Request it on the board →
Runs fully on
Green = the model's best quant fits fully in GPU/unified memory at 8K context. Tap a card for its full "what runs on it" page.
Context
Advertised 1M · no independent evidence yet
No independent long-context evidence has been graded for this model yet — the advertised window above is the maintainer's number, not a usable-context claim.
Run it
Context / KV 8,192 tokens · FP16 set above the quant table
Generic commands (no rig set). GPU-offload values assume the model fits on your GPU — set your rig for values tuned to your hardware.
llama-server -m moonshotai-kimi-k3-unknown.gguf -c 8192 -ngl 999Use llama-cli in place of llama-server for a one-shot prompt.
FROM ./moonshotai-kimi-k3-unknown.gguf
PARAMETER num_ctx 8192
PARAMETER num_gpu 999ollama create moonshotai-kimi-k3 -f Modelfileollama run moonshotai-kimi-k3vllm serve moonshotai/Kimi-K3 --max-model-len 8192Serves on http://localhost:8000/v1 by default.
Load moonshotai-kimi-k3-unknown.gguf, set the context length to 8192 tokens. Set GPU offload to Max (all layers).
Not an MLX-format quant.
MLX runs MLX-format weights only (Apple Silicon). This quant is not an MLX build.
Filename shown is a placeholder. The exact GGUF name appears once the download is available.
Technical details
No template or sampling metadata recorded.
Evidence & provenance
Source
- Provenance
- https://huggingface.co/moonshotai/Kimi-K3
- Revision pin
-
9f62e4e9fffbd0a83ddd60e1c209d828994b3569 - Manifest
- None
License
- Name
- other
- Commercial use
- unclear
- Access
- Open
File hashes (SHA-256)
No file hashes recorded yet.
Explore further
Get an email when a better quant fits your rig.
Set your rig once; we'll alert you when a new or better-fitting build lands.
Performance reports
Real-world throughput reported by the community (and scraped sources).
Community
Reviews, sampler presets and community runtime reports. Be the first to contribute.
Community runtime reports
Unofficial, community-submitted "it loads for me" reports. These are not the official verified-working badge — an admin reviews reports before anything is marked officially verified.
Log in to report whether a quant loads in your runtime.
No community reports yet.