What Is MoE and Why Does It Matter?
Mixture of Experts (MoE) is the architecture that makes Qwen 3.5 special. Instead of running every parameter on every token (like a dense model), MoE splits the model into "experts" — groups of neurons — and only activates a small fraction for each token.
MoE vs Dense — Visual Comparison
Activates ALL 27 billion parameters for every single token generated. High RAM usage, slower on modest hardware.
Has 35B params total, but activates only 3B per token via smart routing. Same quality, fraction of the compute cost.
The result is a useful compute tradeoff: Qwen3.5-35B-A3B routes only part of the network for each token. That can reduce generation compute, but it does not turn the model into a 3B download: the full quantized expert weights still consume memory and bandwidth.
The Qwen 3.5 Flagship Lineup
These four larger checkpoints sit alongside the later compact 0.8B, 2B, 4B and 9B releases described in the hardware section below:
Qwen3.5-35B-A3B
35B total · 3B active · ~20-24GB RAM
Qwen3.5-27B
27B dense · ~32-35GB RAM
Qwen3.5-122B-A10B
122B total · 10B active · ~80GB RAM
Qwen3.5-397B-A17B
397B total · 17B active · ~256GB RAM
Hardware Requirements — What Can You Run?
Here's a clear table of hardware needed for each Qwen 3.5 model with Q4_K_M quantization:
| Model | Active Params | RAM Needed | Recommended Hardware | HF Repo |
|---|---|---|---|---|
| 35B-A3B | 3B | ~20-24 GB | Mac Studio 32GB, RTX 4090 24GB | bartowski/Qwen_Qwen3.5-35B-A3B-GGUF |
| 27B | 27B | ~30-35 GB | Mac Studio 32GB (tight), 2× RTX 3090 | unsloth/Qwen3.5-27B-GGUF |
| 122B-A10B | 10B | ~65-80 GB | Mac Studio Ultra 192GB, 4× RTX 4090 | lmstudio-community/Qwen3.5-122B-A10B-GGUF |
| 397B-A17B | 17B | ~200-256 GB | Multi-GPU server, Mac Pro Ultra 192GB+ | Qwen/Qwen3.5-397B-A17B |
💡 Mac User Quick Guide
- MacBook Air / Pro M4 16GB → Qwen 3.5 4B or 9B ✅ Now available!
- Mac Mini M4 Pro 24GB → Qwen3.5-35B-A3B Q3_K_M works (tight).
- Mac Studio M4 Max 32GB → Qwen3.5-35B-A3B Q4_K_M ✅ the sweet spot.
- Mac Studio Ultra 64-192GB → All models up to 122B-A10B. Beast mode.
- iPhone / Edge / Raspberry Pi → Qwen 3.5 0.8B or 2B 🚀
Hybrid Thinking Mode — Toggle Reasoning On/Off
One of Qwen 3.5's most useful features is hybrid thinking mode. You can ask the model to think deeply using chain-of-thought reasoning, or just get a quick answer without the overhead.
In LM Studio, you control this via the system prompt:
/think
Add /think at the start of your message, or set it in the system prompt.
/no_think
Use /no_think for quick conversational responses without chain-of-thought.
This is especially powerful for agentic workflows: use /think for complex reasoning steps and /no_think for tool calls and simple outputs. No other model family offers this granular control.
How to Run Qwen 3.5 in LM Studio
- Open LM Studio (download at lmstudio.ai)
- Click the Search tab (🔍)
- Type:
qwen3.5-35b-a3b(or your chosen model) - Select the Q4_K_M quantization for the best balance of quality and size
- Click Download (the file will be ~20GB for the 35B-A3B)
- Once downloaded, load it in the Chat tab
- Optional: add
/thinkto the system prompt to enable reasoning mode
⚠️ About Qwen 3.5 Flash
Qwen3.5-Flash is API-only — it is not available for local download. It's designed for Alibaba's cloud infrastructure and cannot be downloaded as a GGUF file. Use the 35B-A3B instead for local deployments.
Qwen 3.5 vs Qwen 3 — What's New?
| Feature | Qwen 3 | Qwen 3.5 |
|---|---|---|
| Context Window | 131K | 256K ✅ |
| Hybrid Thinking | Yes (basic) | Improved ✅ |
| Languages | 29+ | 29+ (deeper) ✅ |
| MoE Efficiency | Good | Fewer active parameters |
| License | Apache 2.0 | Apache 2.0 ✅ |
| Flagship Model Size | 235B-A22B | 397B-A17B |
Verdict — Which Qwen 3.5 Should You Download?
🆕 Qwen 3.5 Small models now available! The 0.8B, 2B, 4B and 9B dense variants landed in early March 2026 — they bring hybrid thinking mode and 256K context to entry-level hardware.
- MacBook Air M4 16GB → Qwen 3.5 4B or 9B. Both run comfortably with hybrid thinking on 16 GB. Perfect for daily use. 4B details →
- You have 32GB RAM → 35B-A3B. Fastest MoE model, incredible for agentic coding, fits a Mac Studio M4 Max.
- You have 32GB RAM and prefer dense → 27B. More predictable, stable quality, good for reasoning tasks.
- You have 80GB+ RAM → 122B-A10B. The best quality you can run locally. Worth every GB.
- You have a server or multi-GPU rig → 397B-A17B. Frontier-level open-source AI. Replace GPT-4o on your infrastructure.
- Edge / embedded / phone → 0.8B or 2B. Runs anywhere, even offline on a Raspberry Pi.
🦀 Find Your Perfect Model
Not sure which Qwen 3.5 to pick? Use LocalClaw's model finder — enter your RAM and get a personalized recommendation in 30 seconds.
Use Model Finder →