LocalClaw/LLM/DBRX (132B MoE)
Open-weight local LLM

DBRX (132B MoE)

Use case: General local assistant. Check the memory fit and choose a setup path below.

128 GB catalogue minimum128 GB RAMQ6_KGeneral local assistant
Choose an app

This is an advanced workstation/server GGUF path. Unsupported apps are clearly marked.

Compare models
LM StudioNot available for this model
Open in UnslothLaunches Unsloth Desktop on this model's download page
OllamaNot available for this model
Open on Hugging FaceFiles, licence and available downloadsOpen llama.cpp setupAdvanced option: opens GGUF files and patch notesUse with LocalClawOptional workspace after the model is installed

Desktop app links require the app to be installed. If nothing opens, LocalClaw will show app-download and model-file fallbacks.

Parameters
132B (36B active)
Minimum RAM
128 GB
Model size
108 GB
Quantization
Q6_K

About DBRX (132B MoE)

Catalogue summary: Databricks open MoE LLM. 132B total with 36B active. Strong general purpose. 111K downloads.

DBRX (132B MoE) has a catalogue minimum of 128 GB RAM with Q6_K. Actual memory use and speed vary by context length, runtime, backend and system headroom.

Treat dbrx-instruct as an advanced workstation/server-grade catalogue target with verified GGUF artefacts. Open the GGUF files and follow the upstream runtime notes; LocalClaw does not claim a one-click LM Studio install.

Public GGUF repository (verified 2026-11-06): dranger003/dbrx-instruct-iMat.GGUF
chatgeneralquality

Deployment path

01
Check RAM fitServer-grade target. Plan for 128 GB class multi-GPU memory.
02
Load the modelOpen the verified GGUF files for dbrx-instruct and follow the upstream runtime or patch notes first.
03
Try your workloadStart with a short prompt, check memory use and adjust context length before running longer tasks.

Catalogue record

  • Family: dbrx
  • Parameters: 132B (36B active)
  • Recommended quantization: Q6_K
  • Catalogue minimum RAM: 128 GB
  • Catalogue model size: 108 GB
  • Tags: chat, general, quality

Practical limits

  • Catalogue RAM is a minimum estimate, not a guarantee for every context length or runtime.
  • Speed and memory use vary by quantization, backend, context length and system headroom.
  • Verify architecture, licence and usage restrictions in the linked upstream material before deployment.

Reading the scores

LocalClaw /10 is an editorial catalogue rating. Community /5 comes from member reviews. Your machine fit is a separate memory and runtime assessment.

Capability profile

Repository catalogue ratings used by LocalClaw's editorial rubric. They are not a standardized third-party benchmark.

speed
2
quality
9
coding
8
reasoning
8

Technical notes

Developer
See upstream repository
License
See upstream repository
Context window
See upstream repository
Architecture
See upstream repository

This model fits these next steps

Hardware fit is based on LocalClaw's RAM tier, model size and quantization metadata. Always leave memory headroom for your OS and runtime.

Large unified memoryMac Studio M4 Max 128GB128GB AI PC classNVIDIA GB10 / DGX SparkHigh-memory picks128GB RAM guide

Related catalogue entries

Linked mechanically by family, shared tags and nearby RAM tier; this is not a quality ranking.

Command A (111B) 111BGLM 4.5 Air (MoE) 106B (12B active, MoE)WizardLM 2 (8x22B) 8x22B (141B total)DeepSeek V4 Flash Vision Exp 284B (13B active, multimodal MoE)Hy3 295B (21B active)Command R+ (104B) 104BMiniMax M2.1 230B (10B active, MoE)Qwen 2.5 (72B) 72B

Where to go next