Local ASR model

Voxtral Mini 4B Realtime 2602

Catalogue summary: Mistral's open-weight 4B realtime ASR model for local streaming transcription. It combines a 3.4B language model with a 970M causal audio encoder, supports 13 languages, configurable delay from 80ms to 2.4s and a production local path through vLLM realtime or Transformers.

Repository editorial metadata; verify comparative claims in the linked upstream material.

GPU recommendedspeech-to-text transcription13 languagesApache 2.0
Choose an app

Start with Recommended. No terminal commands are shown.

Compare speech models

Desktop app links require the app to be installed. If nothing opens, LocalClaw will show app-download and model-file fallbacks.

Catalogue quality
9.2/10
Catalogue speed
9.4/10
Model size
8.9 GB
Voices
N/A (ASR: outputs streaming text)

Can Voxtral Mini 4B Realtime 2602 run locally?

Voxtral Mini 4B Realtime 2602 can run locally for offline speech-to-text. Use the verified setup options on this page; no terminal command is required to choose the right path.

Apache 2.0 license. Still verify upstream usage notes before shipping.

streamingrealtimemultilinguallow-latency

Audio profile

Cat. quality
9.2
Cat. speed
9.4
Audio
9.3

Best fit

Voxtral Mini 4B Realtime 2602 is best for offline transcription, speech indexing and local voice pipelines.

Hardware: gpu

Model details

Type
Local ASR model
Family
voxtral
Latency
ultra-low
Formats
vllmtransformerssafetensors
Languages
en, fr, es, de, ru, zh, ja, it, pt, nl, ar, hi, ko
Context
4B BF16, 13 languages, Mistral card states single GPU with at least 16GB memory

Install locally

01
Check runtimeConfirm the backend supports vllm, transformers, safetensors on your machine.
02
Open recommended setupUse the app and model links above. LocalClaw does not expose a terminal command.
03
Test locallyRun a short private audio prompt before moving into production workflows.

Good for

  • speech-to-text transcription
  • GPU recommended local workflows
  • streaming, realtime, multilingual

Watch before shipping

  • Validate pronunciation, latency and artifacts with your own voice samples.
  • Review the upstream license and acceptable-use notes.
  • Benchmark on your target CPU, Apple Silicon or GPU setup.

Related TTS and speech models

CompareBrowse all TTS models Local AIBrowse LLM models macOS appGet LocalClaw