Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,573

Base only

Active filters: llama-cpp

spiritbuun/buun-Qwen3.6-chat_template

Updated 1 day ago • 22

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 20 • 16.9k • 82

spiritbuun/Nemotron-Labs-Diffusion-14B-Q8_0-GGUF

Text Generation • 14B • Updated 9 days ago • 1.36k • 8

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 719 • 237

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 60.9k • 701

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 22.7k • 300

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 6.09k • 14

hiiamboris/Darwin-28B-Coder-Q4_K_M-GGUF

Text Generation • 27B • Updated 9 days ago • 263 • 3

Abiray/zembed-1-Q4_K_M-GGUF

Feature Extraction • 4B • Updated Mar 11 • 172 • 3

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 194 • 5

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 20 • 3.62k • 16

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 20 • 2k • 9

wangzhang/gemma-4-26B-A4B-it-abliterix-GGUF

25B • Updated Apr 20 • 1.75k • 8

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q2_K-GGUF

Text Generation • 14B • Updated Apr 25 • 572 • 3

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated 28 days ago • 1.85k • 3

kenonix/Darwin-9B-KOREA-Q4_K_M-GGUF

Text Generation • 9B • Updated 15 days ago • 430 • 8

kenonix/Darwin-9B-KOREA-Q8_0-GGUF

Text Generation • 9B • Updated 15 days ago • 71 • 8

Jerzman/PLLuM-4B-chat-2512-Q4_K_M-GGUF

Text Generation • 4B • Updated 8 days ago • 220 • 2

Jerzman/PLLuM-4B-instruct-2512-Q4_K_M-GGUF

Text Generation • 4B • Updated 8 days ago • 189 • 2

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF

Text Generation • 35B • Updated 1 day ago • 215 • 2

Novaciano/Ultimate-RPG.System-3.2-1B-Q4_K_M-GGUF

1B • Updated 2 days ago • 138 • 2

prithivMLmods/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated about 11 hours ago • 933 • 2

v8karlo/UNCENSORED-Wukong-Phi-3-Instruct-Ablated-Q4_K_M-GGUF

4B • Updated Jun 6, 2024 • 121 • 5

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

12B • Updated Jul 22, 2024 • 101 • 2

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 553 • 10

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3.25k • 4

TouchNight/Qwen2.5-14B_Uncencored-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 124 • 2

Novaciano/Llama-3.2_1B_Abliterated_Pairs_RP_GGUF

1B • Updated Dec 22, 2024 • 34 • 1

Hack337/ChatGPT-5-Q8_0-GGUF

0.5B • Updated Apr 17, 2025 • 2.52k • 14

Lucy-in-the-Sky/Dolphin-Mistral-24B-Venice-Edition-Q8_0-GGUF

24B • Updated Apr 29, 2025 • 61 • 1