Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

974

Base only

Active filters: 4bit

Outlier-Ai/Qwen3-32B-MLX-4bit

Text Generation • 33B • Updated May 26 • 18

Outlier-Ai/Qwen3-14B-MLX-4bit

Text Generation • 15B • Updated May 26 • 132 • 1

Outlier-Ai/Qwen3-8B-MLX-4bit

Text Generation • 1B • Updated May 26 • 25

Outlier-Ai/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 8

Outlier-Ai/gpt-oss-20b-MLX-4bit

Text Generation • 21B • Updated May 5 • 32

Outlier-Ai/SmolLM3-3B-MLX-4bit

Text Generation • 0.5B • Updated May 26 • 18

Outlier-Ai/gemma-3-27b-it-MLX-4bit

Text Generation • 27B • Updated May 26 • 44

Outlier-Ai/gemma-3-4b-it-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 32 • 1

uditjain/Nemotron-30B-Math-Instruct-LoRI

Text Generation • Updated Apr 26 • 4

uditjain/Nemotron-30B-Code-Instruct-LoRI

Text Generation • Updated Apr 26 • 27

uditjain/Nemotron-30B-Science-Instruct-LoRI

Text Generation • Updated Apr 26 • 4

uditjain/Nemotron-30B-Multi-Domain-DARE-TIES-Merged-LoRI

Text Generation • Updated Apr 26 • 21

stamsam/MedusaGemma-E4B_MLX_4Bit

Text Generation • 1B • Updated Apr 22 • 11

JANGQ-AI/Qwen3.6-27B-JANG_4M

Image-Text-to-Text • 5B • Updated Apr 25 • 102

lkjiop8/CyberSentinel-9B-bnb-4bit

9B • Updated Apr 23 • 2

soichisumi/harrier-27b-mlx-4bit

Updated Apr 27 • 9

Chunity/Qwen3.6-35B-A3B-AutoRound-AWQ-4bit

Image-Text-to-Text • 7B • Updated Apr 24 • 4.05k • 1

mlx-community/Qwen3.5-27B-OptiQ-4bit

Text Generation • 27B • Updated 16 days ago • 7.27k • 3

SevenOfNine/Aura-4o-Gemma-4-31B-4bit

Image-Text-to-Text • 32B • Updated May 3 • 4 • 1

LibraxisAI/Huihui4-48B-A4B-vmlx-mxfp4

Image-Text-to-Text • 10B • Updated May 12 • 45 • 1

mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 15 days ago • 581 • 3

ovedrive/ERNIE-Image-nf4

Text-to-Image • 4B • Updated May 1 • 3

robertobissanti/EngGPT2-16B-A3B-MLX-4bit

Text Generation • 16B • Updated Apr 26 • 24

LibraxisAI/Huihui4-48B-A4B-vmlx-nvfp4

Image-Text-to-Text • 13B • Updated May 11 • 15

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 9

TheCluster/Qwen3.5-122B-A10B-Heretic-v2-MLX-mixed-3.8bit

Image-Text-to-Text • 122B • Updated Apr 28 • 575

Joesh1/onca-1.5-9B-INT4

Text Generation • 9B • Updated Jun 15 • 7

TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-mixed-3.9bit

Image-Text-to-Text • 35B • Updated Apr 29 • 61

groxaxo/Qwen3.6-27B-abliterated-v2-GPTQ-Pro-FOEM-4bit-g128

Image-Text-to-Text • 27B • Updated Apr 29 • 18 • 1

groxaxo/Qwen3.6-27B-abliterated-v2-GPTQ-Pro-FOEM-4bit-g128-preserve-vl

Image-Text-to-Text • 27B • Updated Apr 30 • 58 • 1