Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

106

Base only

Active filters: quant

eaddario/Llama-Guard-3-8B-GGUF

Text Generation • 8B • Updated Apr 25, 2025 • 2.09k

eaddario/Dolphin3.0-Mistral-24B-GGUF

Text Generation • 24B • Updated May 10, 2025 • 1.44k • 2

eaddario/Llama-xLAM-2-8b-fc-r-GGUF

Text Generation • 8B • Updated Apr 27, 2025 • 339 • 1

eaddario/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 30, 2025 • 975 • 1

eaddario/OLMo-2-1124-7B-Instruct-GGUF

Text Generation • 7B • Updated May 3, 2025 • 642

eaddario/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 1, 2025 • 812 • 4

eaddario/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Jul 1, 2025 • 5.17k • 2

eaddario/gemma-3-12b-it-pruned-GGUF

Text Generation • 12B • Updated Jul 1, 2025 • 794 • 5

eaddario/Qwen3-30B-A3B-pruned-GGUF

Text Generation • 29B • Updated Jul 1, 2025 • 425 • 4

eaddario/Dolphin-Mistral-24B-Venice-Edition-GGUF

Text Generation • 24B • Updated Jul 1, 2025 • 899 • 7

eaddario/Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF

Text Generation • 24B • Updated Jul 1, 2025 • 731 • 1

eaddario/Devstral-Small-2505-GGUF

Text Generation • 24B • Updated Jul 17, 2025 • 463

eaddario/Devstral-Small-2505-pruned-GGUF

Text Generation • 24B • Updated Jul 17, 2025 • 832

eaddario/Mistral-Small-3.2-24B-Instruct-2506-GGUF

Text Generation • 24B • Updated Jul 19, 2025 • 615

eaddario/Mistral-Small-3.2-24B-Instruct-2506-pruned-GGUF

Text Generation • 22B • Updated Jul 19, 2025 • 642

radlab/polish-qa-v2-bnb

Question Answering • 0.4B • Updated Oct 4, 2025 • 9 • 2

jackcloudman/Qwen3-Next-80B-A3B-Thinking-GGUF

Text Generation • 80B • Updated Oct 20, 2025 • 29 • 2

ProGamerGov/qwen-image-int8-quanto

Updated Oct 21, 2025

baonathor/xtrade-v1

Updated Dec 8, 2025 • 3

tsqn/Z-Image-Turbo_GGUF

Text-to-Image • 6B • Updated Dec 12, 2025 • 560 • 3

tsqn/Z-Image-Turbo_fp8_comfyui

Text-to-Image • Updated Dec 16, 2025 • 3.59k • 5

3ndetz/fred-t5-xl-remastered-GGUF

Text Generation • 2B • Updated Jan 5 • 73

eaddario/Apriel-1.6-15b-Thinker-GGUF

Image-Text-to-Text • 14B • Updated Jan 2 • 1.17k • 2

eaddario/GLM-4.6V-Flash-GGUF

Image-Text-to-Text • 9B • Updated Jan 2 • 1.11k • 4

eaddario/Olmo-3-7B-Instruct-GGUF

Text Generation • 7B • Updated Jan 2 • 575

eaddario/Olmo-3-7B-Think-GGUF

Text Generation • 7B • Updated Jan 2 • 1.03k

3ndetz/fred-t5-xl-remastered-CT2

Text Generation • Updated Jan 5 • 12

Abiray/Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF

Text Generation • 3B • Updated Jan 20 • 754 • 4

eaddario/Ministral-3-14B-Instruct-2512-GGUF

Text Generation • 14B • Updated Feb 1 • 1.7k

eaddario/Ministral-3-14B-Reasoning-2512-GGUF

Text Generation • 14B • Updated Feb 1 • 783