LLM Torrents

Qwen

Qwen3-30B-A3B-Instruct-2507

← All models

30.5B parameters · mixture-of-experts · Instruct · Qwen3 family

apache-2.0 hash verified source matched revision pinned

Which version should I download?

Set your rig so we can size a quant to your hardware and show which quants fit.

Set your rig

Quantizations

Format Level Size Verdict Est. speed Quality note Swarm Download
GGUF Q4_K_M 17.28 GB Set your rig — Balanced size/quality — good default. 1S / 0L webseed OK
Magnet .torrent

Run it

Generic commands (no rig set). GPU-offload values assume the model fits on your GPU — set your rig for values tuned to your hardware.

Start the server 
llama-server -m Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -c 8192 -ngl 999

Use llama-cli in place of llama-server for a one-shot prompt.

Save as Modelfile next to the GGUF (Modelfile) 
FROM ./Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf
PARAMETER num_ctx 8192
PARAMETER num_gpu 999
Create 
ollama create qwen-qwen3-30b-a3b-instruct-2507 -f Modelfile
Run 
ollama run qwen-qwen3-30b-a3b-instruct-2507

GGUF is not a first-class vLLM format.

vLLM GGUF support is experimental and single-file only; prefer safetensors/GPTQ/AWQ for production. If you must, pass the .gguf path to `vllm serve` with --load-format gguf on a recent vLLM.

Load Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf, set the context length to 8192 tokens. Set GPU offload to Max (all layers).

Not an MLX-format quant.

MLX runs MLX-format weights only (Apple Silicon). This quant is not an MLX build.

.

@endif
Technical details

No template or sampling metadata recorded.

Evidence & provenance

Source

Provenance
https://huggingface.co/Qwen/Qwen3-30B-A3B-Instruct-2507
Revision pin
0d7cf23991f47feeb3a57ecb4c9cee8ea4a17bfe
Manifest
Present

License

Name
apache-2.0
Commercial use
yes
Access
Open

File hashes (SHA-256)

  • qwen3-30b-a3b-instruct-2507/LICENSE 05cab46843576551502bfdf712f84e93e6e9590d9997306ed4f6635ef82811d9
  • qwen3-30b-a3b-instruct-2507/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf 6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0
  • qwen3-30b-a3b-instruct-2507/README.md 649af14051755c577335465ff82d258e7c8cbf2e95728892b6276b9f1db6931b

Community

Performance reports

No performance reports yet.

Reviews

No reviews yet.

Presets

No presets yet.

Performance reports

Real-world throughput reported by the community (and scraped sources).

View performance leaderboard