Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

39

Base only

Active filters: iq4_xs

YTan2000/Spark-X2.5-4B-GGUF

Text Generation • 4B • Updated 10 days ago • 669 • 1

geantendormi/K2-Horizon-7B-Uno-Uncensored-GGUF

Text Generation • 9B • Updated 2 days ago • 1.42k • 1

Deaquay/T-Rex-mini-IQ4_XS-GGUF

8B • Updated Apr 9, 2025 • 10

Deaquay/T-Rex-mini-I1-GGUF

8B • Updated Apr 9, 2025 • 93

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 54 • 5

kaushall13/Qwen3.5-9B-GGUF-SBGQ

Text Generation • 9B • Updated Mar 26 • 63

ospost/gpt-oss-20b-sft-GGUF

21B • Updated Apr 1 • 41

dxx117/MiniMax-M2.7-IQ4_XS-HQ-GGUF

Text Generation • 229B • Updated Apr 14 • 17

end000/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 19 • 49 • 1

Krasnopjorovs/Qwen3.6-35B-A3B-IQ4_XS-Imatrix

Text Generation • 35B • Updated Apr 22 • 75 • 1

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 48

localweights/Qwen3.6-27B-MTP-IQ4_XS-GGUF

27B • Updated May 7 • 353 • 5

localweights/Qwen3.6-35B-A3B-MTP-IQ4_XS-GGUF

36B • Updated May 7 • 429 • 4

zaydiscold/Qwopus3.6-27B-v2-IQ4_XS-GGUF

27B • Updated May 23 • 14 • 1

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 178 • 1

KeinNiemand/Kuwutu-7B-CYOA-GGUF

Text Generation • 8B • Updated Jun 17 • 124

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 343 • 1

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 209 • 5

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 475 • 2

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 751 • 4

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 327 • 1

pearsonkyle/Ornith-1.0-9B-imatrix-GGUF

Text Generation • 9B • Updated Jul 11 • 406 • 2

xero0000/Gemma-4-26B-A4B-it-vram14-iq4xs-imat

Text Generation • 25B • Updated Jul 19 • 164 • 1

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated Jul 22 • 121 • 13

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated Aug 15 • 4.12k • 10

Verkiki/Qwen3.8-27b-Fable5-Distill-Abliterated-GGUF

Text Generation • 0.5B • Updated Aug 18 • 1.6k • 5

Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF

Text Generation • 27B • Updated Aug 18 • 5.07k • 2

Hob-forge/Qwen3.5-4B-Instruct-GGUF

Text Generation • 4B • Updated 28 days ago • 1.27k • 1

Skttttt/Himeros_27B_IQ4XS

Text Generation • 27B • Updated 26 days ago • 751 • 2

impacte/NVIDIA-Nemotron-3.5-Lightning-GGUF

Text Generation • 33B • Updated 26 days ago • 240 • 2