Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,046

Base only

Active filters: imatrix

mradermacher/LlamaForecaster-8B-i1-GGUF

Question Answering • 8B • Updated Jan 10 • 166 • 3

bartowski/TheDrummer_Anubis-70B-v1.2-GGUF

Text Generation • 71B • Updated Jan 21 • 2.9k • 14

bartowski/moonshotai_Kimi-Linear-48B-A3B-Instruct-GGUF

Text Generation • 49B • Updated Feb 9 • 10.5k • 23

bartowski/huihui-ai_Qwen3-Coder-Next-abliterated-GGUF

Text Generation • 80B • Updated Feb 10 • 74.9k • 30

mradermacher/Qwen3-Coder-Next-REAP-40B-A3B-i1-GGUF

41B • Updated Feb 14 • 1.09k • 16

unsloth/Qwen3.5-122B-A10B-GGUF

Image-Text-to-Text • 122B • Updated Mar 5 • 143k • 290

bartowski/nvidia_Nemotron-Cascade-2-30B-A3B-GGUF

Text Generation • 32B • Updated Mar 22 • 8.14k • 46

mradermacher/Total04-DeepSeek-R1-Distill-Llama-70B-heretic-i1-GGUF

71B • Updated Apr 3 • 11.4k • 3

mradermacher/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-i1-GGUF

31B • Updated 9 days ago • 80.4k • 13

mradermacher/gemma-4-19B-A4B-it-The-DECKARD-Thinking-i1-GGUF

18B • Updated 5 days ago • 3.54k • 3

mradermacher/Qwen3-ASR-0.6B-i1-GGUF

0.8B • Updated Jul 7 • 639 • 4

mradermacher/gemma-4-E4B-it-OBLITERATED-i1-GGUF

Text Generation • 7B • Updated 8 days ago • 5.1k • 17

mradermacher/gemma-4-26B-A4B-it-SOMPOA-heresy-i1-GGUF

25B • Updated Apr 27 • 1.7k • 9

mradermacher/Qwen3.5-9B-RpRMax-v1-i1-GGUF

9B • Updated Jul 7 • 1.88k • 6

bartowski/ibm-granite_granite-4.1-30b-GGUF

Text Generation • 29B • Updated Apr 29 • 1.55k • 14

mradermacher/OmniCoder-9B-Claude-Opus-High-Reasoning-Distill-i1-GGUF

9B • Updated Jul 7 • 1.78k • 7

GianniDPC/Qwen3.6-27B-IQ4_XS-pure-with-MTP-GGUF

Text Generation • 27B • Updated May 19 • 1.38k • 22

mradermacher/Gemma-4-26B-A4B-it-heretic-antislop-i1-GGUF

25B • Updated Jul 7 • 9.02k • 3

mradermacher/Pantheon-Reasoning-26B-A4B-1.1-i1-GGUF

26B • Updated Jun 8 • 2.51k • 4

bartowski/nex-agi_Nex-N2-Pro-GGUF

Image-Text-to-Text • 396B • Updated Jun 12 • 3.87k • 11

deucebucket/Qwen3.6-35B-A3B-Heretic-Cerebellum-GGUF

Image-Text-to-Text • 35B • Updated Jul 5 • 1.77k • 7

kaitchup/Qwen3.6-27B-GGUF-MoQ

27B • Updated Jun 16 • 4.6k • 19

mradermacher/Gemma-4-31B-StyleTune-i1-GGUF

32B • Updated Jul 4 • 10.6k • 17

fableforge-ai/ReasonCritic-7B

Text Generation • Updated 23 days ago • 1.65k • 4

King3Djbl/mythos-9b-unhinged

Text Generation • 8B • Updated 23 days ago • 14.9k • • 28

SixVolts/Qwen3.5-122B-A10B-Opus-Reasoning-MTP-GGUF

122B • Updated 19 days ago • 1.98k • 8

mradermacher/Gemma-4-26B-A4B-StyleTune-V2-i1-GGUF

26B • Updated Jul 3 • 10.9k • 11

unsloth/Qwen-AgentWorld-35B-A3B-GGUF

Text Generation • 35B • Updated Jun 25 • 446k • 220

bartowski/deepreinforce-ai_Ornith-1.0-35B-GGUF

Image-Text-to-Text • 35B • Updated Jun 26 • 39k • 65

mradermacher/Qwen3-VL-4B-Instruct-Uncensored-i1-GGUF

4B • Updated Jul 1 • 2.04k • 5