Qwen 3.6 27B (MTP)
Qwen 3.6 27B dense (not MoE) with Multi-Token Prediction. Sits between the 14B and 35B-A3B as a "single dense model with MTP throughput acceleration." Targets workloads where the MoE activated-param dance isn't ideal but you still want MTP's throughput gains. Published on Hugging Face about a week after the 35B-A3B. Unsloth publishes MTP GGUF quants.
Our verdict
The "I want MTP but not MoE" pick in the Qwen 3.6 family. Dense 27B at Q4 is about 17.1GB on disk — fits 24GB VRAM with 16K context comfortably. MTP needs a supported runtime: Qwen's card recommends vllm>=0.19.0, and unsloth's GGUF card gives the llama.cpp flags. If you tested the 32B from the Qwen 3 generation and liked it, this is the natural upgrade.
Overview
Qwen 3.6 27B dense (not MoE) with Multi-Token Prediction. Sits between the 14B and 35B-A3B as a "single dense model with MTP throughput acceleration." Targets workloads where the MoE activated-param dance isn't ideal but you still want MTP's throughput gains. Published on Hugging Face about a week after the 35B-A3B. Unsloth publishes MTP GGUF quants.
How to run it
Qwen's card recommends vllm>=0.19.0 and gives MTP launch commands for vLLM and SGLang. Unsloth's MTP GGUF card gives --spec-type draft-mtp --spec-draft-n-max 2 for llama.cpp, and says -np above 1 and --mmproj are not yet supported with MTP. Without MTP support, the model still runs but loses the throughput acceleration. On Ollama, ollama pull hf.co/unsloth/Qwen3.6-27B-MTP-GGUF:Q4_K_M gets you up. VRAM math: ~17.1GB weights + ~1.1GB KV at 16K context = ~18.2GB. Only 16 of the 64 layers use full attention and keep a KV cache; the other 48 are linear attention with a small fixed state.
Strengths
Weaknesses
Quantization variants
Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.
| Quantization | File size | VRAM required |
|---|
Get the model
HuggingFace
Original weights
Source repository — direct quantization required.
Hardware that runs this
Cards with enough VRAM for at least one quantization of Qwen 3.6 27B (MTP).
Models worth comparing
Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.
Frequently asked
Can I use Qwen 3.6 27B (MTP) commercially?
What's the context length of Qwen 3.6 27B (MTP)?
Does Qwen 3.6 27B (MTP) support images?
Source: huggingface.co/Qwen/Qwen3.6-27B
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.
Related — keep moving
Verify Qwen 3.6 27B (MTP) runs on your specific hardware before committing money.