← Blog · Model Review · Updated July 28, 2026 ⭐ New

Gemma 4 Suite Deep Dive:
E2B, E4B, 26B-A4B & 31B

Google DeepMind's Gemma 4 family redefines what's possible with open-weights models. Native multimodal vision on every model, blazing efficiency through MoE architecture, and a 128K token context window across the entire lineup.

Native Vision Model-Specific Context MoE Architecture Apache 2.0 Google DeepMind

⚡ TL;DR — What You Need to Know

Updated July 28, 2026: this guide now includes Gemma 4 12B and the official QAT/Q4 memory guidance. Earlier copy treated the launch family as four models and used one context figure for every checkpoint; both have been corrected.

What is Gemma 4?

Gemma 4 is Google's current open-weight multimodal family for text-and-image workloads. It covers edge-size Mixture-of-Experts models, a practical 12B desktop checkpoint, a sparse 26B-A4B option and a dense 31B flagship.

The useful local-AI question is not “which Gemma is best?” but “which Gemma leaves enough memory for context, image input and the runtime on my machine?”

The current Gemma 4 lineup

ModelShapeOfficial approximate Q4 memory*Practical tier
Gemma 4 E2B2B active MoE2.9GB8GB systems and edge experiments
Gemma 4 E4B4B active MoE4.5GB8-16GB general multimodal use
Gemma 4 12B12B dense6.7GB16GB local sweet spot
Gemma 4 26B-A4B26B total, 4B active MoE14.4GB24-32GB systems
Gemma 4 31B31B dense17.5GB32GB+ workstation

*Google's published estimates include roughly 20% runtime overhead but not every possible KV-cache, image or application allocation. More context requires more memory.

Which Gemma 4 should you download?

QAT, GGUF and local runtimes

Google publishes quantization-aware trained Q4 artifacts for the family. QAT can preserve more quality than converting a floating-point checkpoint after training, but format still matters: a Google QAT release, a GGUF build and an MLX conversion are different artifacts.

LM Studio, llama.cpp-derived runtimes and MLX can all be relevant depending on the checkpoint. Match the model format to the runtime rather than downloading the largest file and assuming every app can load it.

Multi-Token Prediction support

Gemma 4 also has matching MTP drafters for speculative decoding. LM Studio moved MTP support to stable in version 0.4.14. A drafter can improve generation speed without changing the target model's output distribution, but the real gain depends on acceptance rate, context and hardware.

Read the full Gemma 4 MTP guide before enabling it on a production workflow.

Multimodal use

Gemma 4 is designed for unified text and image input. That makes it useful for screenshots, document pages, UI inspection and private visual analysis. Image resolution, tiling and maximum context vary by model and runtime, so use the exact checkpoint card for production limits.

LocalClaw verdict

Gemma 4 12B is the family sweet spot for most 16GB and 32GB users. E2B/E4B win on speed and footprint, 26B-A4B offers an interesting sparse step up, and 31B is the workstation choice. The family is unusually coherent, but no single memory or speed number applies to every checkpoint.

Official sources

Browse All Gemma 4 Models

4 models indexed — from the tiny E2B to the flagship 31B. See benchmarks, hardware requirements, and GGUF download links.