Qwen

Qwen3-TTS-12Hz-1.7B-Base

1.9B parameters · Base · Qwen3 family

apache-2.0 source matched revision pinned

Nothing to download yet — not yet mirrored

We haven't mirrored a torrent for this model yet. The metadata is cataloged, but no downloadable build exists here right now.

Request this model on the board

Which version should I download?

Default pick: safetensors · BF16 — BF16 source weights (official Qwen3-TTS-12Hz-1.7B-Base) — reference TTS artifact. GGUF community-only; safetensors is the universal format (Transformers/vLLM). Bundles speech_tokenizer codec (+682MB) + tokenizer/config.

We don't have architecture data for this model, so we can't estimate whether it fits your hardware.

safetensors · BF16

3.59 GB

Est. speed
Swarm

BF16 source weights (official Qwen3-TTS-12Hz-1.7B-Base) — reference TTS artifact. GGUF community-only; safetensors is the universal format (Transformers/vLLM). Bundles speech_tokenizer codec (+682MB) + tokenizer/config.

Not yet available

Want a different quant? Request it on the board →

Run it

Context / KV 8,192 tokens · FP16 set above the quant table

Generic commands. We don't have architecture data for this model, so we can't estimate whether it fits your hardware.

llama.cpp loads GGUF files only; this quant is a safetensors build.

Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.

Ollama runs GGUF builds only; this quant is a safetensors build.

Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.

Serve an OpenAI-compatible endpoint
vllm serve Qwen/Qwen3-TTS-12Hz-1.7B-Base --max-model-len 8192

Serves on http://localhost:8000/v1 by default.

Install
pip install transformers accelerate torch
Load and run (run.py)
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Qwen/Qwen3-TTS-12Hz-1.7B-Base"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype="auto",
    device_map="auto",
)

Loads the weights straight from the repo; point model_id at a local directory to use your downloaded copy.

LM Studio loads GGUF (and MLX on Apple Silicon) only; this quant is a safetensors build.

Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.

MLX runs MLX-format weights only (Apple Silicon). This quant is a safetensors build.

Safetensors weights run under vLLM or transformers; a GGUF conversion, if one exists, is a separate quant row.

Technical details

Sampling defaults

top_k
50
top_p
1
temperature
0.9
repetition_penalty
1.05

Stop strings

<|im_end|>

Evidence & provenance

Source

Revision pin
fd4b254389122332181a7c3db7f27e918eec64e3
Manifest
None

License

Name
apache-2.0
Commercial use
yes
Access
Open

How verification works →

File hashes (SHA-256)

No file hashes recorded yet.

Explore further

Get an email when a better quant fits your rig.

Set your rig once; we'll alert you when a new or better-fitting build lands.

Set your rig

Performance reports

Real-world throughput reported by the community (and scraped sources).

Community

Reviews, sampler presets and community runtime reports. Be the first to contribute.

Reviews (0)

Log in to write a structured review of this model.

No reviews yet.

Sampler presets

Log in to share a sampler preset or vote on presets.

No presets yet.

Community runtime reports

Unofficial, community-submitted "it loads for me" reports. These are not the official verified-working badge — an admin reviews reports before anything is marked officially verified.

Log in to report whether a quant loads in your runtime.

No community reports yet.

selected to compare · pick at least 2