#1Best match
PrismML Apache 2.0 ternary Qwen3.8-27B derivative with official GGUF and MLX paths. The PQ2_0 pack is 7.21GB, PTQ1_0 is 5.95GB, and custom llama.cpp/MLX kernels target laptop-class local inference.
Parameters27.36B (ternary)Minimum RAM16GBQuantizationPQ2_0Model size7.2GB
View model details →#2Best match
Official OpenBMB compact on-device LLM with Apache 2.0 licensing, 131K context, tool-calling and coding focus, plus official Q4_K_M GGUF, Ollama, llama.cpp, Docker and OpenClaw run paths.
Parameters2BMinimum RAM4GBQuantizationQ4_K_MModel size1.6GB
View model details →#3Best match
Liquid AI hybrid model built for on-device assistants. 8.3B total / 1.5B active, 128K context, tool use, GGUF, ONNX, MLX, llama.cpp and LM Studio support. Open-weight under LFM 1.0.
Parameters8.3B (1.5B active)Minimum RAM8GBQuantizationQ4_K_MModel size5.2GB
View model details →#4Best match
IBM Granite 4.2 8B instruct model with Apache 2.0 weights, 128K context, thinking-mode chat template, tool calling and practical GGUF plus MLX paths for everyday local machines.
Parameters8.8BMinimum RAM8GBQuantizationQ4_K_MModel size5.2GB
View model details →#5Best match
Official MIT reasoning model from Ornith AI with a 262K native context window, tool-calling focus, and official Q4_K_M GGUF, MLX and Ollama/llama.cpp paths for local coding-agent experiments on 16GB+ machines.
Parameters9BMinimum RAM16GBQuantizationQ4_K_MModel size5.63GB
View model details →#6Best match
IBM Granite 4.1 long-context instruct model. Apache 2.0, 131K context, tool calling, RAG, code tasks, multilingual dialog and business assistant workflows on normal 8-16 GB machines.
Parameters8BMinimum RAM8GBQuantizationQ4_K_MModel size5GB
View model details →#7Best match
Ai2 fully open 7B OLMo 3 instruct model with Apache 2.0 licensing, transparent training artifacts and established GGUF options from Unsloth, bartowski and LM Studio for everyday local machines.
Parameters7BMinimum RAM16GBQuantizationQ4_K_MModel size4.5GB
View model details →#8Best match
Established Qwen 3 8B model with thinking mode, strong general capability and broad GGUF runtime support.
Parameters8BMinimum RAM8GBQuantizationQ5_K_MModel size5.5GB
View model details →#9Best match
Qwen 3 vision-language model. Strong OCR, document understanding, chart & UI reasoning. 128K context with native image+video inputs. Apache 2.0.
Parameters8BMinimum RAM12GBQuantizationQ4_K_MModel size5.2GB
View model details →