Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

165

Base only

Active filters: 2bit

MercuriusDream/Qwen3.5-35B-A3B-MLX-2bit

Image-Text-to-Text • 35B • Updated Feb 28 • 49

cudabenchmarktest/personaplex-7b-turbo2bit

Updated Mar 29 • 8 • 7

lew96123/qwen3.5-0.8b-custom-packed-2bit

Image-Text-to-Text • Updated Apr 6 • 11

lew96123/qwen3.5-0.8b-custom-packed-turboquant_mse-true-uniform-2bit

Image-Text-to-Text • Updated Apr 7 • 5

JANGQ-AI/GLM-5.1-JANG_1L

Text Generation • 74B • Updated Apr 25 • 40 • 1

JANGQ-AI/GLM-5.1-JANG_2S

Text Generation • 73B • Updated Apr 25 • 102 • 3

majentik/Qwen3.5-27B-TurboQuant-MLX-2bit

Text Generation • 3B • Updated 6 days ago • 257

majentik/gemma-4-31B-TurboQuant-MLX-2bit

Image-Text-to-Text • 3B • Updated 6 days ago • 155 • 1

majentik/gemma-4-31B-it-RotorQuant-MLX-2bit

Image-Text-to-Text • 3B • Updated 6 days ago • 200

majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-2bit

Image-Text-to-Text • 3B • Updated 6 days ago • 218

majentik/gemma-4-E2B-it-RotorQuant-MLX-2bit

Image-Text-to-Text • 0.9B • Updated 6 days ago • 88

majentik/gemma-4-26B-A4B-RotorQuant-MLX-2bit

Image-Text-to-Text • 3B • Updated 6 days ago • 158

majentik/gemma-4-E2B-TurboQuant-MLX-2bit

Image-Text-to-Text • 0.9B • Updated 6 days ago • 124 • 2

majentik/gemma-4-E4B-RotorQuant-MLX-2bit

Image-Text-to-Text • 1B • Updated 6 days ago • 139

majentik/MERaLiON-3-10B-RotorQuant-MLX-2bit

Automatic Speech Recognition • Updated Jul 20 • 33

majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-2bit

Text Generation • 3B • Updated 6 days ago • 520

majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-2bit

Text Generation • 0.4B • Updated 6 days ago • 429

majentik/gpt-oss-20b-TurboQuant-MLX-2bit

Text Generation • 4B • Updated 6 days ago • 493

OsaurusAI/MiniMax-M2.7-JANGTQ

Text Generation • 15B • Updated May 5 • 37 • 1

AngelSlim/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated Jun 23 • 17 • 11

AngelSlim/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated Jun 23 • 189 • 23

tencent/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated Apr 29 • 170 • 28

tencent/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated Apr 29 • 143 • 35

aoiandroid/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated May 1 • 9

senjiangchen/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated May 1 • 5

JANGQ-AI/Hy3-preview-JANGTQ

Text Generation • 22B • Updated May 11 • 32

zjiayu064/Qwen3-30B-A3B-Base-BitsMoE-2bit

Text Generation • 4B • Updated Jun 3 • 62

zjiayu064/Qwen3-Next-80B-A3B-Instruct-BitsMoE-2bit

Text Generation • Updated Jun 3 • 21 • 1

zjiayu064/DeepSeek-V2-Lite-BitsMoE-2bit

Text Generation • 3B • Updated Jun 3 • 34

ekryski/Qwen3.5-0.8B-2bit

0.4B • Updated May 26 • 28