moonshotai
Kimi-K3
2,779.9B parameters · mixture-of-experts · Instruct · Kimi family
Recommended download
Which version should I download?
Default pick: safetensors · BF16
Set your rig to confirm it fits and to see if a higher-quality quant runs fully on your hardware.
| Format | Level | Size | Verdict | Est. speed | Quality note | Swarm | Download |
|---|---|---|---|---|---|---|---|
| safetensors | BF16 | 1.42 TB | Set your rig | — | — | 0S / 1L webseed OK |
Want a different quant? Request it on the board →
Some builds of this model are low on seeders. Help seed it →
Context
Advertised 1M · no independent evidence yet
No independent long-context evidence has been graded for this model yet — the advertised window above is the maintainer's number, not a usable-context claim.
Run it
Runtime completeness (BF16 torrent): llama.cpp – Ollama – vision sidecar –
- – llama.cpp — no GGUF artifact for this torrent
- – Ollama — not an Ollama-native artifact
- – vision sidecar — non-GGUF vision artifact
Context / KV 8,192 tokens · FP16 set above the quant table
Generic commands (no rig set). GPU-offload values assume the model fits on your GPU — set your rig for values tuned to your hardware.
llama.cpp loads GGUF files only; this quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
Ollama runs GGUF builds only; this quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
vllm serve moonshotai/Kimi-K3 --max-model-len 8192
Serves on http://localhost:8000/v1 by default.
pip install transformers accelerate torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "moonshotai/Kimi-K3"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
model_id,
dtype="auto",
device_map="auto",
trust_remote_code=True,
)
Loads the weights straight from the repo; point model_id at a local directory to use your downloaded copy. This repo ships its own modelling code, so trust_remote_code=True is required — read that code before running it.
LM Studio loads GGUF (and MLX on Apple Silicon) only; this quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
MLX runs MLX-format weights only (Apple Silicon). This quant is a safetensors build.
Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.
Technical details
No template or sampling metadata recorded.
Evidence & provenance
Source
- Provenance
- https://huggingface.co/moonshotai/Kimi-K3
- Revision pin
-
9f62e4e9fffbd0a83ddd60e1c209d828994b3569 - Manifest
- Present
License
- Name
- kimi-k3
- Commercial use
- unclear
- Access
- Open
File hashes (SHA-256)
-
moonshotai-kimi-k3-bf16/.eval_results/apex-agents.yaml
576ccc93fc22aeffcf0bb7346a864b931d75894f0897119ce1d66de671021072 -
moonshotai-kimi-k3-bf16/.eval_results/deep-swe.yaml
59728f597c5bc12bf87513b905508bcd0ddc5689d819972007610f43bfc533b3 -
moonshotai-kimi-k3-bf16/.eval_results/gpqa.yaml
65870556e2ef9004d72a966cfba1ca9639b99f1825d9812060a13d3809dbfe6e -
moonshotai-kimi-k3-bf16/.eval_results/hle.yaml
2b6c92d5f91476d1ebcbebd7f7e77a1ce042e5d77a544ccab1cc42dec149e703 -
moonshotai-kimi-k3-bf16/.gitattributes
a2279e56e2c16d0648ab43dc60517acfaf219c682c58d21eebfe180df99d4e6f -
moonshotai-kimi-k3-bf16/LICENSE
20c797ce19af0c17de52c6afb144644768a591c521655f5ebf5712c9850f2887 -
moonshotai-kimi-k3-bf16/README.md
57de265b5842dfa465c6e73b368b0e15a89b8793b5450528dad577da202cc6fe -
moonshotai-kimi-k3-bf16/assets/kimi-logo.png
4a80f64242bf907940765adc7bcf340c28dd83334b07c5503792a26495d1933b -
moonshotai-kimi-k3-bf16/config.json
9710e121a58d03ac92c8d6da287a19541994319afbbe6d6202af001ffd379213 -
moonshotai-kimi-k3-bf16/configuration_kimi_k3.py
735eb9ebe593e17d231e08e1df7f7be9b5ee0e079f511aa201f9572077b416ae -
moonshotai-kimi-k3-bf16/encoding_k3.py
b9cb7ae100fed34b9337f80dacee5abbf7e261fe9b74bc0e76366701d46f5333 -
moonshotai-kimi-k3-bf16/generation_config.json
c6648c25e9705af7fba8847e243840d21b5cc63ddeb6297f750a7ddbb6a02836 -
moonshotai-kimi-k3-bf16/kimi_k3_processor.py
ec9f7e86d2ab0eee07a8e7e7c037046e77ac3c25a710ad1298ec13be3b585b54 -
moonshotai-kimi-k3-bf16/kimi_k3_vision_processing.py
d122b30bfd3a51a6f05d4bfcfda1e657827322b1353f7caefeebc2835d7736b5 -
moonshotai-kimi-k3-bf16/media_utils.py
78403540328f9847d6b7ebc5c44eb2e6a752863de0afb7d0710728bb161dc60d -
moonshotai-kimi-k3-bf16/model-00001-of-000096.safetensors
975584c00f85a95fce8ae0f840af8cef69c2ef4db00d34cab3e2cbdfc60f6e51 -
moonshotai-kimi-k3-bf16/model-00002-of-000096.safetensors
26a3284e1d2cb567934ebef002e6a1813551d646739e8bcb1e9e3fe7f878e0f5 -
moonshotai-kimi-k3-bf16/model-00003-of-000096.safetensors
e54af9de4c554956082364010f732443bcd5097390f0121a33fb35e37280b5a9 -
moonshotai-kimi-k3-bf16/model-00004-of-000096.safetensors
5955fd8feda89b1af8400c25e885e7177d47edff155f54b318beb8dd1cec5c05 -
moonshotai-kimi-k3-bf16/model-00005-of-000096.safetensors
d60d68ad0381ffd2d8716d5991a65993cc81837455bf05d1c76ea3a75662e268 -
moonshotai-kimi-k3-bf16/model-00006-of-000096.safetensors
b1d4805767471a9721cd087d2047843ab9262d4f9bbe0d4a306e72c07179f939 -
moonshotai-kimi-k3-bf16/model-00007-of-000096.safetensors
fb1120fef34c0416e73a3259ae6114b9a82b6081871b368a199e0b265cac7df7 -
moonshotai-kimi-k3-bf16/model-00008-of-000096.safetensors
2318dda54fc1985b63d6068de54fbe312ac87317c902666c9075aa5e10e8a1c9 -
moonshotai-kimi-k3-bf16/model-00009-of-000096.safetensors
8b66cdde34f5130cf4f99ec35b16f1f6d33bf0ec946cf2a5612004f5d399f998 -
moonshotai-kimi-k3-bf16/model-00010-of-000096.safetensors
d34f55f7b734a1eaecc986fc7f92bcaa1b7d18fad90a33befd3fae4f1b2771a9 -
moonshotai-kimi-k3-bf16/model-00011-of-000096.safetensors
1738856a4cca2e356510892de4accf3c3f94b9f598b0394a87e7951740ba4a21 -
moonshotai-kimi-k3-bf16/model-00012-of-000096.safetensors
c6b9bef38415f509898fa7b5c04d20c6fee84b0e02c05d74259d201fe6f3868b -
moonshotai-kimi-k3-bf16/model-00013-of-000096.safetensors
3cbf43d56d9c80be0f848a4866e290741c697e09d885dc2351b0a11de514d9c8 -
moonshotai-kimi-k3-bf16/model-00014-of-000096.safetensors
ce5f343f07d408c64fb247bbe8691edb84d54e3976d3ff586ebcf5929fd143ad -
moonshotai-kimi-k3-bf16/model-00015-of-000096.safetensors
b55caa8013348498525eef2b1416a657f0c28264ada9b245df19d2eea168b4c1 -
moonshotai-kimi-k3-bf16/model-00016-of-000096.safetensors
5a63e63ced659c1996b02ccabdea977546a39ecce025af1e54552de3bfc0489e -
moonshotai-kimi-k3-bf16/model-00017-of-000096.safetensors
622bfa605205f4ef65e44dac07246bea79e18123ae8b84ab33eec89b6364c3a9 -
moonshotai-kimi-k3-bf16/model-00018-of-000096.safetensors
838b265ebb86a1320e589685779125d224663160823873b9e5930cf63fafe796 -
moonshotai-kimi-k3-bf16/model-00019-of-000096.safetensors
599a8ecf88f21d4c91295b4160e7564e501807535e522195ee45050a04f17ded -
moonshotai-kimi-k3-bf16/model-00020-of-000096.safetensors
8e01b61ab76655ca0c5bd6645303a00c05fb58da94e00f978a9ef1e8114a6f0f -
moonshotai-kimi-k3-bf16/model-00021-of-000096.safetensors
1944265bd024ea6caa23796326e420260a801e5c52e6253155f22ce97e9578d0 -
moonshotai-kimi-k3-bf16/model-00022-of-000096.safetensors
2d32d3e3c8da0764f73830289c6a22224f755c0cf058df0262fb0f83b3777029 -
moonshotai-kimi-k3-bf16/model-00023-of-000096.safetensors
c291f2ec15788cb24cdf791c6d68dbf8803b26d01415cff3fab367cba581a169 -
moonshotai-kimi-k3-bf16/model-00024-of-000096.safetensors
278855ab81d42337e2a1857f136d740911fe3f5b1813dc21ce2cb03dc5c3cde3 -
moonshotai-kimi-k3-bf16/model-00025-of-000096.safetensors
6e3ae6ad868f5b38fa7ddface520796ea251568b07447deee3d164a0a32d862b -
moonshotai-kimi-k3-bf16/model-00026-of-000096.safetensors
cdd79fb52c7a3350926c4b947ae82cccd0af17fa3fb537c5694a4cedf2b59811 -
moonshotai-kimi-k3-bf16/model-00027-of-000096.safetensors
1d974b40c4aeb5cc0adeba6f9fbad25fc99f8cd39f9dd3513aeb2fb30a9c4188 -
moonshotai-kimi-k3-bf16/model-00028-of-000096.safetensors
1bec58e89ab7835d3ca40e581cc6f047cb93de47fda804eaea4e2407e01c3ed3 -
moonshotai-kimi-k3-bf16/model-00029-of-000096.safetensors
c3bf0e738aa5fbd6ca3ecad982aba8d09efffd58b40cd8fb62d02fe0492f5ceb -
moonshotai-kimi-k3-bf16/model-00030-of-000096.safetensors
7b996410482ad3c21700ed35d3f2b36282540db92b5631a31aeda1c5e90d6343 -
moonshotai-kimi-k3-bf16/model-00031-of-000096.safetensors
c26689540a2471fe690c441a6cf9bec8f00471930e3131962206fd992e0d377c -
moonshotai-kimi-k3-bf16/model-00032-of-000096.safetensors
f7dc9e726d46d5c7c2c35af2eea4860cc89dd38a52b60591358a5ca7899c5159 -
moonshotai-kimi-k3-bf16/model-00033-of-000096.safetensors
615afa33b69cbaa42122bb3bcce92e40d6de86713a301c43c5d1bc2ac4342c1b -
moonshotai-kimi-k3-bf16/model-00034-of-000096.safetensors
a53b27fe92df11e77aec7c5de93ac148b9e2a7bac95020535f68854a7977bde7 -
moonshotai-kimi-k3-bf16/model-00035-of-000096.safetensors
9f4b44c89e4965a973f4fa71eaa0f8ada110f588065541e83bf52692feaa886d -
moonshotai-kimi-k3-bf16/model-00036-of-000096.safetensors
55aef33fab36df93731289ba38d0ce516d9880c100be5f69f933d0af80bf3c6e -
moonshotai-kimi-k3-bf16/model-00037-of-000096.safetensors
e95dd3599d6918f5a22bc7b1256aaee9147f40aa05f43135d083d511eb5cbd80 -
moonshotai-kimi-k3-bf16/model-00038-of-000096.safetensors
1ce472771309248fd1155313dc3f72daa6fcc4793fba86d6c5d6a758ff6254ae -
moonshotai-kimi-k3-bf16/model-00039-of-000096.safetensors
9c75b18c0d3a5088e13973dde519e74ead5c7b1df216dcd623b7ee561f378057 -
moonshotai-kimi-k3-bf16/model-00040-of-000096.safetensors
6f664598c00aee095174db1f860182652ff9b808f53c7764f70e071c6f8a4893 -
moonshotai-kimi-k3-bf16/model-00041-of-000096.safetensors
375f05f94a59d1509bef0976269fceb8f28d40e161d4903e64f735b1ede405c2 -
moonshotai-kimi-k3-bf16/model-00042-of-000096.safetensors
b65947611d6c150394955f4637d4b05007f20a9b1c0f0f02bcf45d0ae2a428ba -
moonshotai-kimi-k3-bf16/model-00043-of-000096.safetensors
b5a425f100bbfaf804ac2dcca197ccf8fb3a910b6aa79d93e3a103b0146a8309 -
moonshotai-kimi-k3-bf16/model-00044-of-000096.safetensors
113ee012044206e9156dd683cb97ee5f27b07d0a4f936cbda457cd0bcf8ca336 -
moonshotai-kimi-k3-bf16/model-00045-of-000096.safetensors
eb0698659da59c469020a03b3aa8d9ef847fc6359b2513b6720746a44da6f4de -
moonshotai-kimi-k3-bf16/model-00046-of-000096.safetensors
0270727a399c553a602360b04bc1b5feaf09b22e12e3bb7eea5261801d4a1024 -
moonshotai-kimi-k3-bf16/model-00047-of-000096.safetensors
b38f63eb08036cdf766a078c93ee037630d6481ded26065150915b8deaf03bb8 -
moonshotai-kimi-k3-bf16/model-00048-of-000096.safetensors
131e243c02cf2dc713de108edb8bfdb01c7ee28ce59d0a6615a630fb7cf0e4ae -
moonshotai-kimi-k3-bf16/model-00049-of-000096.safetensors
72c91dcf2909ead55b6b5234e725227effbcd59fa5ce9f552e91c48d423cef0f -
moonshotai-kimi-k3-bf16/model-00050-of-000096.safetensors
0a627a082cd39ee7d55f7440a5012c1fe084313f970e7d4351bb08d8ac7f5f2a -
moonshotai-kimi-k3-bf16/model-00051-of-000096.safetensors
38a37bcec20abe1ddfaf68a636cd61cd291b71d554419a57736fd97d08a8cbff -
moonshotai-kimi-k3-bf16/model-00052-of-000096.safetensors
9703b632174112ea051aaa2ca8b67558ffbf41a4699d042580ff11f26ec28e0a -
moonshotai-kimi-k3-bf16/model-00053-of-000096.safetensors
413ec9ea0b693161c5e8a393a7a6be40a9f3c27114a919e1302fe94daeeee621 -
moonshotai-kimi-k3-bf16/model-00054-of-000096.safetensors
0e3da201b765929787e40c2fb8cd0cfb3476bfb9b95d7eb59b7d1066960606a2 -
moonshotai-kimi-k3-bf16/model-00055-of-000096.safetensors
e7c9f4e44f8ac95f73048078c406781fb0418831089fd2f7c55459887606204b -
moonshotai-kimi-k3-bf16/model-00056-of-000096.safetensors
efd6176016b9fab27cca7710dce7ed599f06bbba1a8b126cfc76781b42c0e880 -
moonshotai-kimi-k3-bf16/model-00057-of-000096.safetensors
e6982c96ac9101b75ab32c56568f5740ddae771acad29d92750b95aeeb3a7a30 -
moonshotai-kimi-k3-bf16/model-00058-of-000096.safetensors
c93a23cbd6530391dcd9ce5617d24fb759e380f5ca676f83d00c8d6a9cda896f -
moonshotai-kimi-k3-bf16/model-00059-of-000096.safetensors
a62eb822071036421fa4aab662dafe3a3873b1b926378ebf489cddfd48a4d5de -
moonshotai-kimi-k3-bf16/model-00060-of-000096.safetensors
9bccbaa71b98f8526ca4c6cb091a489063ec4734c84bb5f6d11eeb0512360b5f -
moonshotai-kimi-k3-bf16/model-00061-of-000096.safetensors
1ae3969540fc676480804c37adc54df77e5ebb923952abb46d398b3a2d612e9d -
moonshotai-kimi-k3-bf16/model-00062-of-000096.safetensors
96babdc24f2203eed68bd88f8534546696ab35bb1d0db7a5f15aaee295deee68 -
moonshotai-kimi-k3-bf16/model-00063-of-000096.safetensors
8a81caa697a7baf491393d83e3b85e14a0d025f5ee2ca91561528e8aec5c63ea -
moonshotai-kimi-k3-bf16/model-00064-of-000096.safetensors
325c72d6ca5aaefd020da647ac317621903c8576a97d1de664b93638b7172f39 -
moonshotai-kimi-k3-bf16/model-00065-of-000096.safetensors
276d1cce1d8d494526938d878d4afb713ca379f98064dcd3c505325c954639db -
moonshotai-kimi-k3-bf16/model-00066-of-000096.safetensors
2ebd83fea628d8cf7496a936f66a8a7f1b430bc8438644ae6ac9761ac056194e -
moonshotai-kimi-k3-bf16/model-00067-of-000096.safetensors
f0228892f8199c29c5053e7e5388a60dacf1458b53eb6f471e1f548f02478dd1 -
moonshotai-kimi-k3-bf16/model-00068-of-000096.safetensors
fa75764056d16855c42baffd474bcc01045deda7ed5f773d88ff8887ea8458b6 -
moonshotai-kimi-k3-bf16/model-00069-of-000096.safetensors
9375584663bd3073cd95df18c3dc99fd4346c0c71dfdeec686a4891b7768a738 -
moonshotai-kimi-k3-bf16/model-00070-of-000096.safetensors
ab53464148721a209d4941dc3ab6f698574f913179e729726d00ed6232144893 -
moonshotai-kimi-k3-bf16/model-00071-of-000096.safetensors
28ac0d3286ffc5c8567cc3b265500777ba2b75a0a5c6a273c87a5c9cfd8a8a5b -
moonshotai-kimi-k3-bf16/model-00072-of-000096.safetensors
0a269faaf8ea2daccef499e7c1501089ea05386ca7c6a5a9d4150fd38e37673b -
moonshotai-kimi-k3-bf16/model-00073-of-000096.safetensors
a1b2e79e1bb7c9e0ade3f0825b748024a5207317589fc57f91dc2540443d716a -
moonshotai-kimi-k3-bf16/model-00074-of-000096.safetensors
df945022b493373bdcacc3903cc406978342dff2c1b3ace5278b1909fb1d2479 -
moonshotai-kimi-k3-bf16/model-00075-of-000096.safetensors
8c6d7cb12f7c51aa88207c5b9410fccfa44e4a9022efc75d73c06054c1296c05 -
moonshotai-kimi-k3-bf16/model-00076-of-000096.safetensors
d5174eb5de19274b0fe62d466bfb21bac3b03d6d9676b801c6fea1ed57657998 -
moonshotai-kimi-k3-bf16/model-00077-of-000096.safetensors
8707eacfd69e8be65c7052551834e7ac26945b9ddf915939e08f5eb813c6a262 -
moonshotai-kimi-k3-bf16/model-00078-of-000096.safetensors
2773d41de168c7373bf2f7f9994cbbb2712c379503578d8462aa783db7cba128 -
moonshotai-kimi-k3-bf16/model-00079-of-000096.safetensors
da02c8a46b81f42a64330e0e31478dcd7b020633a65251b535817431bba1d96b -
moonshotai-kimi-k3-bf16/model-00080-of-000096.safetensors
96b5accdf3bc2b4651979361fa7f6191197b8573c36ab6a58effce487402b177 -
moonshotai-kimi-k3-bf16/model-00081-of-000096.safetensors
01562aa616ea3dc398a7c40b4d9c3c4700885541efeaed6dbd1ba8076cae9c4b -
moonshotai-kimi-k3-bf16/model-00082-of-000096.safetensors
8cba090734d9a3900276cca442bd6fa60f5206ce0c70884f7b2df3df877485bd -
moonshotai-kimi-k3-bf16/model-00083-of-000096.safetensors
6ceebf8ce621712dd3185943224ca83a45f5bc310c272df7dee4b69e3dfc87fe -
moonshotai-kimi-k3-bf16/model-00084-of-000096.safetensors
c3f1318e7e1cc6893230a14c229a0c9ec0037cb1d0912a395f9222a3e8a8bc2d -
moonshotai-kimi-k3-bf16/model-00085-of-000096.safetensors
633b2e3b86ec35f87fa4216b14bba49fc4058a1296433bc22b0576925118b6ad -
moonshotai-kimi-k3-bf16/model-00086-of-000096.safetensors
add4056ab3ecaa7befdac2e00280d294ce470d541917ac90df8fc50497df7fb0 -
moonshotai-kimi-k3-bf16/model-00087-of-000096.safetensors
f6d608f2c40b584b775db184013e37740d4710abad414c584408e0ad09fb486b -
moonshotai-kimi-k3-bf16/model-00088-of-000096.safetensors
87afe43b8a71d2cc56787a976f52f8c35bcfbe85df7d0c445194bc1f4d7e0c4a -
moonshotai-kimi-k3-bf16/model-00089-of-000096.safetensors
24016b28cfdf9420ae2f411145ef919cf2e1ec667830aded439bfb761c61755f -
moonshotai-kimi-k3-bf16/model-00090-of-000096.safetensors
1ecd85dbd77ce081f6238b894f8a7da2ff40346da7042c427a52d83562dbb5ea -
moonshotai-kimi-k3-bf16/model-00091-of-000096.safetensors
a4e666132aed052b4bf174f56853b70cbb2ada898fe568f60e0cdf3ad46a0a4a -
moonshotai-kimi-k3-bf16/model-00092-of-000096.safetensors
359848294be55e1c8949f0a4c92098bc73276895289fd1123f10769ba685e248 -
moonshotai-kimi-k3-bf16/model-00093-of-000096.safetensors
d31d58d1bd3fcb8c350ef497d2acd23e0fe768ab5c0621e60f20b03d611f64e6 -
moonshotai-kimi-k3-bf16/model-00094-of-000096.safetensors
ad66e1cb96b86963e63d6a0a466b6a407b13c9815cb480fe612480cc6bb3b6e1 -
moonshotai-kimi-k3-bf16/model-00095-of-000096.safetensors
01d41139abb8cf3b5288a97318cc4ab92676671b4eb141031cd80d7c3ced6122 -
moonshotai-kimi-k3-bf16/model-00096-of-000096.safetensors
9d10c74fc10161bef9463a8541a634a97f521f43c99368ea7243ce0c79cdbf7c -
moonshotai-kimi-k3-bf16/model.safetensors.index.json
a1c5210650ce71d2d3ae9ec5a101ac4afd3cf4b10091be589853437eb967febd -
moonshotai-kimi-k3-bf16/modeling_kimi_k3.py
b9171c96726eda55234c92ac8dfae7e24c512fda68968ae8f2c3782b42665ea2 -
moonshotai-kimi-k3-bf16/modeling_kimi_linear.py
9e3564c70ac21854ce5a090cc946c5dc76b70d1050ef50840449181a20fff44a -
moonshotai-kimi-k3-bf16/preprocessor_config.json
4be333605990c53a816e586dee9d5dd545afb7a59947c17f8f7ef26b4782668e -
moonshotai-kimi-k3-bf16/tiktoken.model
b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103 -
moonshotai-kimi-k3-bf16/tokenization_kimi.py
f28ea66e2d862a2a5814970b2ce40c2f7d8296ff09aed90a7e7def689b906944 -
moonshotai-kimi-k3-bf16/tokenizer_config.json
5d0803c94db9cd78763499e0956c95fd5a225c14a727e5a6cf5db3f96f010a6e
Explore further
Get an email when a better quant fits your rig.
Set your rig once; we'll alert you when a new or better-fitting build lands.
Performance reports
Real-world throughput reported by the community (and scraped sources).
Community
Reviews, sampler presets and community runtime reports. Be the first to contribute.
Community runtime reports
Unofficial, community-submitted "it loads for me" reports. These are not the official verified-working badge — an admin reviews reports before anything is marked officially verified.
Log in to report whether a quant loads in your runtime.
No community reports yet.